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OVEkVIEW 



The Job Corps'* is a primary alternative education mecManisra. 
It serves, youth, who have iPostly failed in or^been failed 
by the education system. Seven of eight enfoilee? have not 
compietedTiigh schoor; The^median achievement level at entry 
is below the sixth grade level. 

Job , Corps provides comprehensive '^educational opportunities. 
The basic education program consists of a standard set of 
materials graded for skill levels with a unit system of 
instruction and progression. There is a low student/teacher 
ratio to allow individualized attention. When students 
progress to roughly the eighth'" grade achievement levels 
they are .usually placed in the General Equivalency Degree 
j>rogram. This,' too, is a standardized package of self-paced 
linits. An off-center Advanced Career Training Program in 
Colleges and^Post Secondary Vocational Institutions has been 
instituted to provide.the full range of Job Corps services 
and^ support for CorpSmembers who have the capability to con- 
tinue their education In colleges and vocational schools. 
Finally, ent>:ants into Job Corps are provided initial basic 
life skills and world of work ihstrT::tion- which will hopefully 
guide' vocational choice in Job Corps and be of some help as 
well to early leavers. 

Job, Corps centers provide an exellent laboratory for testing 
and implementing new approaches for educating disadvantaged 
youth. The curriculum is established according to Federal 
standards and the centers are responsive to national direc- 
tion. The centers provide 'a relatively standardized and 
self-contained environment so that it is possible to reduce 
exogenous influences on experimental activities. The data 
system in Job Corps is one of the most elaborate of any 
social program, providing detailed information on partici- 
pant characteristics/ on vocational, education and other 
activities and achievements while in Job Corps, as well as 
on subsequent labor market experiences. 

Job Corps has, in fact, a history of innovation and 
experimentation in educational curricula. ].ts standardized 
self-paced and individualized approach was at the vanguard 
of the alternative education movement in the 1960s. Copious 
studies have been undertaken of the effectiveness of this 
approach. Educational gains testing was, for several years 
a basic element of Job Corps performance monitoring. 
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The Educational Improvement Effort (ElE) , therefore, 
utilizes the Job Corps' potential as an experimental labora- 
tory to carefully test alternative approaches and for 
teaching economically and educationally disadvantaged 
youth. ^ 

The EIE follows a logical sequence, beginning with a survey 
of the varying teaching methods and policies within Job 
Corps centers as well as a .review of past evaluation literature. 
Cooperatively with the education community, exemplary 
education approaches outside of Job Corps were assessed for 
applicability for disadvantaged youth in a center environment. 
With some adaptation,, the most promising models were then 
implemented in multiple centers. A research infrastructure^ 
and management information sysi:em were established in experi- 
mental centers. Under a carefully designed and controlled 
research strategy, repeated cohorts of Corpsmembers are randomly 
assigned to the models and to traditional Job Corps offering^. 
Their educational gains over a standardized period are 
measured. A range of process information is gathered about 
the .experiences of- participants, as well as of staff who 
administer the new models. Job Corps individual program 
data are combined with the process and educational gains tests 
to assess the impact and effectiveness of the various 
approaches.. 

The lessons from EIE extend far beyond Job Corps. The 
demonstration and \esearch intrastructure which^.has been 
put in place permits as close to "pure experimental" conditions 
as can be achieved in an operational setting, so that a 
range of alternative approaches on educating disadvantaged 
youth can be tested and refined. 

This interim report describes the beckground and structure 
of the Educational Improvement Effort as well as the prer 
liminary findings for the first cohorts of participants 
and controls in the models implemented earliest. The 
findings are rather remarkable if 'they hold up over time. 
The tested gain rates of Coi^jsmembers in regular programs 
exceed both public school averages ^and the lower learning 
rates previously achieved by the Corpsmembers when school* 
The gain rates also exceed those documented for Job Corps 
in the past'. The evidence ^on the relative effectiveness 
of traditional and /innovative approaches is limited at this 
point in timfe, but"^ to date, it does appear that some alterna- 
tives are promising, particularly, computerized instruction 
approaches. It is very clear that the indi'vidualized, self 
pared instructional approach used in Job Corps can positively 
affect learning rates of even the most disadvantaged youth. 
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This volvime is one of . the products of , the "knowledge 
development" effort implemented under the mandate of the 
Youth Employment and Demons traction Projects Act of 1977, 
The. knowledge development effort .consists of hundrejds of ' 
separate research, . evaluation and demonstration activities 
which will result in literally thousands of written 
products. The activities have been structured from the 
outset -so that each is self-standing but also interrelated 
witti a.host of oth^er activities -The framework ic presented 
in A Knowledge Development Plan for ^the Youth Employment and 
Demonstration Projects Act of 1977 , A Knowledge Development 
Plan for the Youth Initiatives Fiscal 1979 and Completing 
c the Youth Agenda; A Rlan for Knowledge Development , 
Dissemination and Application in Fiscal 1980 > " 

Info3nnation is available^or will be coming available from the 
various knowledge development activities to help resolve ^an 
almost limitless array of issues, but answers to policy 
questions will usually retquire integration and synthesis 
from a number of separate products', which, in turn, will 
depend on knowledge and availabrlity of these products* 
A major shortcoming of past research, evaluation and demon- 
stration activity has been the failure to organize and 
disseminate* the products adequately to assure thefyll- 
exploitation of the findings • Thp magnitudfe--.aiid'"''s^ 
of the youth knowledge development^.^.^ffor^'^^ a premium on 
organization and dissem^^ 

As par^gf-'itS'Ta^ developmiSnfc iriandate , therefore/ the 

iDf-&rCe''bf Youth Programs of the Depa^ftment of Labor will 
organize, publish and disseminate the written products of 
all major reseairch, evaluation" and demonstration activities 
supported directly by or mounted in cbn junction with the 
knowledge development effort. Some of the same products 
may also be published and disseminated through other channels 
but they will be included in the structured series of Youth 
Knowledge Development Reports in order to facilitate access 
and integration. ^ 

The Youth Knowledge Development Reports , of which this is one 
are divided into twelve broad categories: 

1, ^Knowledge Development Framework ; The products in 
this category are concerned with the structure of knowledge 
development activities, the ass'essment methodologies which 
are employed, validation of measurement instruments, the 
translation of knowledge into policy, and the strategy for 
disseminating findings. 
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2. Research on Youth Employment' and Bmployability 
Development ; The products in this category represent analysis 
of exJkstmg data, presentation of findings from new data 
sources, special studies of dimensions on youth labor market 
problems and policy analyses, 

* %. 

3. Program , Evalua t ionsT The products in this category 
include impact, process and benefit-cost evaluations of youth 
progrcuns including 'the Summer Youth Employment Pr<^rrram, -Job 
Corps, the Young Adult Conservation Corps, Youth Eniployment 
and Training Progreims, Youth Community Conservation and 
Improvement Projects, and the Targeted Jobs Tax Credit." 

4. Service and Participant Mix ; The evaluations and 
demonstrations summarized m this category concern the 
matching of different types of youth with different^^service 
combinations. This involves experiments with work vs. work 
plus remediation, vs. straight remediation as treatment options. 
It also includes attempts to ^ mix disadvantaged and more 
affluent participants, as well as youth with older .workers. 

5. Education and TraAnina! A^proat;hes : The products 
in this category present the findings of structured experi- 

JiientjS-JtQ-- test the impact and ef fe ctivepfigg; nf varjong f^rinn;^- 

tion and vocational training approaches including specific 
education methodologies for the disadvantaged, alternative 
education approaches and advanced career training. 

6. Pre-Employment and TransitioD Services ; The products 
in this category present the findings of structured experi- 
ments to test the impact and effectiveness 'of school-to-work 
transition activities, vocational exploration, job-searcb 
assistance and other efforts to better prepare youth for labor 
market success. 

7. Youth Work Experience ! The products in this category 
address the organization of work activities, their output > 
productive roles for youth and the impacts of various employ- 
ment approaches. 

.8. Implementation Issues ; This category includes cross- 
cutting analyses of the practical lessons concerning "how- 
to-do-it.'* Issues such as learning curves, replication 
processes and progreuranatic "batting averages" will be addressed 
under this category, as well as the comparative advantages of 
alternative delivery agents. 
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9. Des i cfn and : Orgari^zaTt'lohal /Alternatives : The 
products in This category represent assessments of demon- 
strations of alternative jirogramVa^ arrangements • 
such as consolidation, year-round^preparation 'for svimmer 
programming, the use of incentives and multi-year tracking 
of individuals. 

' 10. . Special! Heeds Groups : The products in this category 
present '^'findings on the special problems of and adaptations 
needed for; significant segments including minorities, young 
mothers, tro\;p:>'led youths Indochinese refugees and the handi- 
capped. . ^ J^" ' • 

7"^lJy^~ lInnovati^ Apprachesl The pro'Sucts in "this category 
present the findings ox those activities designed to explore 
new appr oache s. \ The subjectjg co^^ incltide the. Youth 
Incenjtive Entitlement JPilot Projects, private sector initia- 
tives> the natipnal "^youth service experiment, and energy 
*initia,tives in -weeUAierizatloh, low-head hydroelectric dam 
restoration, Vi'ndpower and the like.- 

12. Institutional Linkages : The products in this category 
will include studies\of institutional arrangements and linkages 
as well as assessments of demonstration ,activltie^LJ:b_^ncQurage^ 
.such linkages with edikcation, volunteer groups, drug -abuse 
agencies and the like.\ 

In each of these knowledge development categories, there will 
be a range of discrete demonstration, research and evaluation 
activities , focused on different policy, program and analytical 
issues. For; instance, all experimental demonstration projects 
have both process and impact evaluations, frequently under- 
taken by different evaluation* agents.. Findings will be 
published as they become, available so that there will usually 
be a series of reports as evidence accumulates. To organize 
these products, each publlcktion is classified in one of the 
twelve broad knowledge development categories, described in 
terms of the more specific issue, activity or cluster of 
activities to which it is addressed, with an identifier of 
the product and what it represents relative to other products 
in the demonstration-. Hence, the multiple products under a 
knowledge development activity r.re closely interrelated and 
the activities' in each broad cluster have significant inter- 
connections . \ 

There are several other Youtn, 'Knowledge Development Reports 
closely related to this volume^ Alternatiye Education Models — 
Interim Findings' ;from the Iteplfcfation of the Career Intern 
Program provides data on community based aiteffnatiYe education 
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approaches. In the program evaluation category, th^ two- 
volume Assessments/pg Job Cojcps Performance and Impacts, 
and The Lasting Imi)acts of Job corps Participation provide 
background information on Job Corps educational programs 
and their impact. 



ROBERT TAGGART 

Admini?strator 

Office of Youth Programs' 
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.FOREWORD 



The EIE evaluation Is an Important segment of research and assessment 
which is being sponsored by the Office of Youth Programs of the 
Department of Labor in FY 1979 and FY 1980. While this particular 
effort Is applicable to the OdtTCorps, results sWouVd impact orTth^ 
-larger scope of youth initiatives activities. 



Knowledge development has alweiys been a basic mission of Job 
Corps. With its broad mandate to provide comprehensive services 
to the disadvantaged, with its detailed. and uniform reporting 
procedures, Job Corps provides the controlled conditions so 
important, in research and demonstration activities. The law 

specifies that Job Corps should contribute ";..to the deyelfljKiierrf 

and dlssem1nat1on_.ot„techniques for working with-the--disadvantaged 
that can be widely utilized by public and private institutions and 
the agencies."; The law also specifies that •'The Secretary shall 
* provide for the careful and systematic evaluation of the Job Corps 
program, directly or by contracting for independent evaluations, 
with a view to measuring specific benefits, so far as practical, 
and providing information needed to assess the effectiveness of 
program procedures, policies, and methods of operation." 
(Knowledge Development Plan for Youth Initiatives, FY 79, p. 17) 



It is to fulfill these latter legislative mandates as well as to 
attempt to provide Job Corps enrollees with the best possible 
education that the EIEAwas conceived. 



The parameters of the EIE are carefully delineated within the text of 
the 1979 Knowledge Development Plan (p. 40). They, are: 

• The reading program In the Job Corps will be revamped 
based upon assessments of available educational materials 
and approaches. 



X 
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- • The characterlstk's; of the educatlbjiaV ^^^^^ 

.Iteacher training,. studenVpup11«^at1os., materials developed 
at different' centers, pay 1e^ rates, and enrollee 

perceptions will be determined 'In a tomprehenslve, survey of 
education In Jjob Corps. 

• A.stu<ly of computer-assisted Teaming and other promising 
education approaches w111 select models for testing within 
Job Corps. 

• Alternative' educaftionaV enrichment approaches Incliiding 
those emphasizing (1) new materials, (2) computer assisted 
education, (3) teacher motivation and training ond (4) 
pupil, motivation, will be Implemented In alternative 

{centers linder a carefully designed, experimental program to 
determ1r»s which. is most cost-effective In Improving Job 
.Corps . learning rates . 

• A data system arid network would be established to- provide 
for continuing additions. to and adaptations of the various 
models and to assure-.their evaluatlori In a consistent 
fashion. , 

The Knowledge Development Plan states that the EIE should "yield 

some early evidence about ther impacts of different approaches on 

educational gain rates, dropout rates, and attitudes toward 

gducatlon." Further, It should "determine the longer term Impacts 

of different education-gains and further ef"nioyab111ty" and will 

attempt to aid In the Identification of "potential early termlnees 

In order to give them extra assistance." It Is to enable the. 

accomplishment of these gbaTs that this :evaluat1on has been 

designed.'? 



V,-. 
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^ -XHAPTER I > REVJEW ,(F TOt' LitW EbUGATION 
- IN THE JOB.CpRPS' 

Corpsmembers enter at~very low levels of actual educational 
attainment, despite having completed many more years of school than' 
their attainment scores reflect. According to an ABT study based on 
Job Corps data,. 66 percent of corpsmembers in 1969 had reading levels 
below sixth grade and 64 percent had similar math level*;, while in 
1971 the corresponding figures were 69. percent and. 76 percent. 
Therefore, between two-thirds and three-quarters of Job Corps, entrants 
have reading and math skills below the level necesary for the 6ED. 
Also, the study showed that Virtually no corpsmembers (only 3 percent 
to 7 percent) have high school level skills. 

According to past studies, most Corpsmembers show some gain during 
their Job Corps stay. In general T the lower the beginning level, the 
greater the. gain. However, some studies indicate that this tnay be due 
more to remembering what had been forgotten rather than assimilation 
of totally ^.new material. While nearly 80 percent of Corpsmembers in 
the introductory (below third grade) program showed gains in the 1969 
data, 66 percent of those in the elementary program (third to sixth 
grades) showed gains, and this was further reduced to about one half 
of Corpsmembers showing gains in the intermediate (seventh and .eighth 
grades) program. 



Not only were fewer waking gains, but those who did were gaining at a 
progressively slower rate. 

About three quarters of all Job Corps participants have ccmpleted j 
formaV schooling only through tenth grade and those that stay In Job 
Corps the longest, have completed the least amount of schooling* 
This. would Indicate that those who need the program most (or know they 
have the fewest "outside" opportunities") opt for the longest stayi 
However, another study (Engl eman, 1971]i^ound that the educational 
level associated witn longest length of stay was 6,3 grade levels on 
entry, perhaps Indicating frustration at one end and boredom at the 
other* - ■ ^ _ 

Engleman (1971) found average gains to be .69 grade levels of 4,8 
months (reading) and ,70 (math). This rate was achieved by those at a 
6J entry grade level* Also, the higher the entry level, the lower 
the rate of gain, and there was no significant difference between 
centers* 



Math gains were more precisely correlated' with length of stay than 
were reading gains; Engleman concluded that vocational education 

classes act inore as reinforcers and refreshers for math rather than r 

/ 

reading skills. ^ ^ ' / 



In general, while Job Corps parti cipajits' gains did not meet/4r exceed 
public school norms, they probably exceeded gains the Corpsmemblers 
themselves had actually achieved in the public schools* ; 



I \ 
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It must be cautioneBr^^that the "gains testing of Job Corps was rather 
"hit or miss." There was wide fluctuations In oalns reported, as much 
as .Sy^month. Thus, validity and reliability of procedures Is highly 
suspect. 



Only a minority of Corpsmembers are advanced enough at entry to 



eventually achieve a 6ED. It is difficult to determine from the 
literature jusy what percentage of Corpsmembers actually earn the GEO, 
but at least one stu<jy suggests that a tenth of all enrol lees and two 
fifths of those staying beyond four months (average stay is nearly six 
months) gain a GEO. As of September 1978, approximately a tenth of 
enrol lees were achieving the GED and three tenths at least entered the 
program.^ Of those taking the GED test, nine out of ten passed it 
and received a GED certificate. The higher the entry level 
(naturally) the greater the chance of earning the GED. 

According to several studies, earning a GED is probably the most 
valuable benefit to be derived from Job Corps. While studies 
fret|uently mention that the vocational educatic.i sepent is the most 



popular area with Corpsmembers, employers tend to regard Job Corps 
experience or vocational training, as insufficient experience for the 
I ; actual trade. Project Thresholds 's (an experimental New York City 
halfway house) experience with Corpsmeh and employers. showed that: 



A high school diploma or GED is the best job 



preparation^ tte; Cqrpsn^^^^ ♦ ^Slgnifjicant- 

ly more Corpsmen who^h^ (|High 
SchcioT Equival^nty) retained longer as 

oppbsed to th^M^^^ ho^6ED;:\ the same re- 

lationship existe'd-bet^^ high 
school \graduatei and^^ GED* s. I . * 

The^ifitloma or GEO shbn^^^^^ the iime nec^essary 
to secure empTo^ and u^ualy as'sisted jthe 
Corpsmah in finding work that was /directliy related 
to his vocational goals and interests. ' i 



Jhere are several important factors contributingfto how satisfied the. 
Corpsmember is with the education program and how much gain he or she 
attains while in' the program. Besides length of stay andlevel.at 

O . "I 

entry (as discussed above) the research suggests the following: 



1. Correspondence between Corpsmembers's Pre-Entry Expectations 
and their perceptions of Job Corps actuality: The closer the fit, the 
more satisfied the Corpsmember.. The most recent study (Mathematica, 
1978) suggested thai the education program (along with job training) is 
most likely to be rated positively among the various segments of 
Corpsmembiers, and that it closely fits previous expectations.* However, 
females, blacks, and older enrollees are more. likely to rate the 
edu cation progr am positive ly. 



2. Alternation of Scheduling: Studies have found that alternating 
basic education with vocational training makes for higher Corpsmember 
satisfaction and better retention. The va§t majority of enrollees view 
Job Corps as a job program rather than an academic program and higher 
satisfaction and greater correspondence with expectations Is achieved 
If all Corps'members ' programs Include vo.catlonal .fisucatlon. 
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■- indeed, Tn;a-few Conserva'tioh Cehter^s wher^ daily alternation was 

impossible^ die toyttie distance df work sites/ this was felt to be a 
. major cause of lower retention. 

The main difficulty with alternating the two segments appears to be 

i '' ■ ' - 

that vocational education presupposes competence in basic skills 

'('•>• 1 ■ ' 

which- Corpsmembers may.brily be acquiring. Thus, there is a need 

. ei'ther to find materials, and structure experiences to match 

Cqrpsmember levels, and/ar to incorporate vocational content Into the 

. Basic Education Program. However, the first approach may further 

minimize the work experience value of vocational education, since the^ 

program may be so simplified that the experience does not correspond 

tb actual work. The second approach may alienate Corpsmembers who 

want work experience, not more formal schooling. 



tf basic education courses are not specifically vocational iti content, 
then the studies indicate that there should be "posltipning |of general 
^ducation courses in terms of thefr relationship to economic 
self-sufficiency, e.gl, the job itself, money management, career path. 



etc." 



3,. Feedback/Time Completion: Yankelovjch„founijthat. Corpsmembers 
have a strong need for time-limited completions and quick feedback. 
In other words, Corpsmembers need to be able to measure progresi 
through unit-completion type programs, ^have clear sense that they^ , 



is 



are-at^a certain level, and have finished and "put away" previous 
levels. Alsb.'Yankelovlch suggests that Corpsmembers be given" a 
prediction of just how long thfey need to stay In Job Corps to complete 
their stated goals, since those who feel It "could go oh forever" are 
likely to give. up due to lack of any sight of goal attainment 

4. Remedial or Compensatory Education: According to work at the 
Omaha Job Corps Center, Intense remedial reading programs were found 
effective only with those at 4v9 reading level or below. Other 
studies suggest that there Is a stigma attached to being pulled out of 
the classroom or regular programs, or being assigned to a special 
program for the very lowest levels, so such remediation should 
probably take pUce within the normal setting . 

5. Incentives: The evidence for gains related to Incentives Is 
uncertain, but generally Is unfavorable. In a study at the L.A. Job 
Corps Center, a $5 award was -offered to counteract hj(pothes1zed apathy 
or antipathy to gains testing— If a gain was shown over the previous 
score, the award was made. There was no s1gn1f1can((: dif^fersence 
between the groups. / 



Injexpeftments with points and token econony systems, the 
administrative "bookkeeping" requirements were found to-be too complex 
and too time consuming, and to generate too many /arguments and 
attempts to "beat the system" on the part of Corpsmembers. 
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Besides frequency and vitality of Interaction, teacher attitude is a 
significant affector of student performance. Communicated concern, 
high expectations coupled with high confidence in students, and, in 
general, old-fashioned love and concern have a profbunti effect on 
student achievement. Many studies rate this as the most Important 
determinant. This argues for programs with a high degree of teacher- 
student interchange as opposed to self-instruction. 

In summary, the literature concludes that most Corpsmembers enter Job ' 

/ 

Corps at a very low educational level and make some gains, though 
usually not enough to earn a GED. Programs should have materials which 
are geared in subject to adults and which are perceived as directly 
levant in content to employment and, parti cularly,,j/oeairion^^ 



However, while materials are ar}ji;nportant area of concern for Corps-' 

i 

members iCorpsmemter- teacher interaction is the most significant deter- 
'nnnant of actual gains. 

Receipt of the GED certificate shortens the time necessary to find/ a 
job, makes it more likely that the Corpsmember will flnclxone close to 
his or her interests, and increases the Corpsmember' s retention 1^ a 
job. There is indication that a GED is the single best job preparation 
a Corpsmember can have. However, the majority of Corpsmembers enter at 
too low a reading/math level and/or stay too short a time to- achieve the 
level necessary for the GED. 

\ 

\ 

^ \ ... ■ • 
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It has been found that scheduling close alternation of the academic 
and' work experience segments leads to better retention in the program 
However, . Corpsmembers prefer the work experience and job training to, 
basic education, and the vocational education is much more a break| ' 

from the academic rathfer than vice versa. 

\ 

Corpsmembers appear to view the purpose of Job Corps as job skills 
training and tend to object to sepents which are reminiscent of 
their (frequently detested) experience with formal education. 
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. 'chapter 2. ASSESSMENT 'OF EDUCATION IN ■ 
JOB CORPS 

As part of the Educational Improvement Effort (EIE) a survey was con- 
ducted to provide baseline information to aid in the determination of 

. the need for and the methods of improving the Job Corps Basic Education 
and GED programs* The data contained in this section were obtained from 
a sample of 39 Job Corps centers. Of these, 15 were Civilian Conser- 

-vation^Centers^{CCGs) and 24-were Contract^Center.s,*., The breakdown of 
cienters by region is as follows: ^ 

^ -^TABLE \ - - 

■ Description of Sample _ 



•Region 


Contract 


.ccc 


Total 


3 


5 


0 


5 


4 




4 * 


8 


5 


3 


1 


4 


6 


5 


. 3 


8 


7 & 8 


3 


4. 


7 


9 


2 


0 


2 


10 


2 


3 


5 
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This yielded 39 interviews with basic educatioii directors or their 
designees, 3|S!0 interviews with teachers, and approximately 800 
interviews with Corpsmeiibers. A corapl^j^ifs'tligLOf the sampled 
centers may be found'ln^ppendix A to t^i^'^'chapter. 



Basic Education Direction Questionnaires 

Specifically, the Basic Education "Director Questionnaire yielded 
current data relating ^ such things asr' what ongoing recordkeeping 
practices are; what tests/^ if any, are routinely being used to measure 
educational gains; what is the success rate of the existing GEO 
programs; art what coiTJorate-and/or center-developed materials are 
being used tc supplement the basic program. 

— Educational Gains Measurement 

Most centers are using the entry testing, progi^ams provided by Job 
Corps (the longstanding MJSl, MJS2, and RJSl tests) for initial 
assignments into educational programs. Of the centers surveyed, 92.5 
percent are using the WSl and MJS2 tests for mathematics placement, 
and 93.5 percent administer the RJSl test for reading placement. 
Although the RJS and MJS tests are widely used, there are varying - 
opinions concerning the effectiveness of these tests in determining 
educational competencies. A breakdown of this data may be found in 
Table 2. ' 
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. ■ :- . ■ -./Table''?- . ■■- 

Table 2. Percielved Effectiveness of the RJS sand MJS Tests 
Basic Education Director Response ■ 





Perceived" Effectiveness 




111 CI 




J*- 


(Low) 


1 . 


14% ' 


14% 


3% . 






2 \. 


• 16% 


8% 


. 3% 


5 V ' * ' 


* » J« 


3 ' 


• 31% 


24% 


' 17% 






4' 


^ 27% 




36% 


' ^ , > 

i' ; , 


(High) . 

> 


5 - 


•..11% 


14% 


36% 




(Don't (Know) 




1% 




" 5% 



A wide variety of individuals appear to be administering these tests. 
Jable 3 shows the percentage of centers Indicating administration 
personnel for the RJS and MJS tests. 
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Administrator • 

'< 
\ 
•< 


Percent of Centers Reporting 


MJSl and MJS2 


< 

RJSl 


< 

> 






Teacher 


33% 


31% 


Counselor 


7% 


3% _ 


Orientation Specialist 


-20% 


17% . 


testing Specialist 


11% 


15% 


Other 


30% 


34% 



Data also Indicate that there Is no consistent time across centers 
when these tests are being a(fin1n1stered. Eighty-two percent of. the 
surveyed fcenters administer these tests during Corpsmember orientation 
week,' but the day varies. Literature In the field of measurement 
indicates that mar\y factors mn Influence test results* among these 
are numerous conditions, within the' Individual . It Is possible that 
placement results. may be Influer^ed by newness of surroundings. 



homesickness,, the test administrator, etc. For these reasons, a 
fairly standard adininistratibn time for placement tests maiy be 
beneficiajl. . While a procedure such as this could not guarantee 
consistency of Corpsmember placement across centers, it may serve to 



e^cy 



minimize, at least, some of these extraneous factors. 



Educational gains are tfeing measured in approximately 88 percent of 
the cen;ters; howeyer^^/a wide variety of instrumentation is being used 
for this purpose. Very few centers are using the MJSl and MJS2 and/or 
the'RJSl to measure educational gains* Table 4 presents these 
percentages. 



TABLE 4 

' Use of MJSl, MJS2, and RJSl to Measure Educationj(l Gains 









Use for Gain Measurement 


MJSl and M0S2 


RJSl 


Yes 


14% 


4% 


- ~ \ 

No 


86% 


96% 



A wide variety of gains- testing instrumentation is being used. The 
SAT, Woodcock, LAC, and Sullivan tests are being used for reading 
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pre- tests;, LAC anC SAT- are being used for reading post- tests,. For the 
.^mathematics program, centers Indicate that the Woodcock/Key Math, 
American Guild, SAT, Sectlorv-D/Unit Tests, atnd MJSl are being used. 
These results Indicate that enough divergence of Instrumentation Is 
being usied that little comparative gain score Information from one 
center to another could be considered valid. 

I^alntenance and storage of the test data vary widely from teachers' 
files, to computer storage, with approximately 50 percent of the 
centers Indicating that teachers do maintain these records, at least 
Initially. Of the centers reporting, 60 percent state that 
educational gains records are only maintained while the Corpsmember Is 
on center, while 33 percent Indicate that they maintain these records 
longer than 12 months" after the Corpsmember leaves. Again, these data 
demonstrate little consistency across centers. 

2. GEO Program' 

The data on the GEO program provided relevant Information about the 
existing curriculum and Its Implementation. Because of the wide 
variation In the size of the surveyed centers, there Is considerable 
diversity In the number of Corpsmembers who enter the GEO program on a 
per month basis. Seventy- two percent of the survey centers report 30 
or fewer entering GEO students per month. The remaining centers have 
anywhere from 30 to 100 Corpsmembers entering the GEO program on a per 
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iiibnth basU. Al thougMils quite Targ 

with researcher expectMion. - L 

•, •- •■ X-. ., 



It Is 



consistent 









•TABLE 5* 




• 








GEO Data • 






Region 


.Total 


Corpsmeinbers Eligible Corps- 


GED Employees 




Job Corps Eligible for'^meitibers Actually' Completing 




Enrollment GED 


Enrolled. In GED 


GED . 






Number Percent Number 


Percent 


** Number Percent 


3, 


6,894 


1,081 


16% 695. 


64% 


/ 621 89% 


4 


18,471. 


3,690 


20 2,125 


58 


785 37 . 


5 


6,039 


714 


12 635 


89 , 


344 54 


6 


23,660 


4,157 


18 1,997. 


48 ; . . 


1 ,530 77 


7 & 8 


14,960 


1,852 


12 1,673" 


90 


1 ,436 86' 


9 - 


3,281 


823 


25 562 


68 


472 84 


10 


8,127 


1,825 ^ 


22% 1,572 


86% 


814 52% 



* Bised on Job Corps National Office Data 
**A11 percentages are rounded, 

Basic education directors were asked to distinguish between students 
who' enter the GED program when they arrive on center and those who 
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TABLETS 

How Students Enter The GED Program 



Percentage of Total 



t/Percentage of Centers Reporting 



Students Enter GEO 
/ on Aprlval 



Students Enter 
GEO through - 
Basic Education 



Below 10% 


. 33% 


• 3% 


10-20% 


,15% 


' 0% 


20-30% 


15% 


8% 


30-40% 


15% ' " - 


3% 


40-50% 


3% 


3% ■ 


50-60% 


. 8% 

• 


8% - 


' 60r70%. 


0% 


8% 


; 70-80%" 


. -.5% .. * 


11% 


1 80-90% 


. ;3% 


14% 


/ 90-100% 


3% 


42%-^^ 


- • . . • ' a - ,1 



Eighty-seven percent of the centers surv 
placed In the. GEO program on the basis of 



4 



eyea 



report that students are 
tisst scores, but data also 
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indicate that there is little, if any consistency in tihe utilized 
placement tests. The SAT advanced test is used by 55 percent of the 
centers reporting;. 31 percent use HJSl-^nd RJSl, while 14 percent use 
other instruments. This suggests that comparable test criteria for 
.placement into GEO do not exist across centers. A further implicatit)n 

✓ • * 

Is that a single standard of test performance is not used for GEO 
placement. 

Approximately 29 percent of the reporting centers indicate that 
students can be placed into the GEO program on the basis of criteria 
•Other than test scores or counselor recommendation. Placement into 
GEO is further confounded by the fact that students can, in at least 
one center, be placed into the GEO oh the basis of only the 
counselor's recommendation. This further illustrates the lack of 
consistency of placement procedures across the centers. 

The percentage of students who have successfully completed the GED 
program and test during the last three months and the percentage 
meeting state certification ret^uirements also vary dramatically across 
centers. The data are presented in Table 7. 
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• Percen^ges of Students^ the GEO Test 

and: Meet State CeUi ft cation Require^^ 

' - . 7. ■ '/- 





/ P^ercentage 


• / , ", . ". • 

OT venter .Keportins 


♦ 


/ Da' ' rim Tac^ 


/meet uertiTi cation 
Kequi reinenrs 




'0* 

y 


v; M* 

/ 

ft* 


10-20% 


11% 
1 lip 




17% 

/ 


1 1*> 


30-40S 




40-50* 


6% 


5% 


50-60% 


14% 


5% 


60-70% 


9% / 


5% 


70-80% 


6% / 


13% 


80-90% 


9% 


11%' 


90-100% 


17%; 


34% 



/ 



Approximately 76 percent of the centers report that it takes three to 

■ ■ / , \ 

^ix months for a strident to complete the GEO program. Only 11 percent \^ 

of the centers report that they acini riister the GEO test on center. A \ 

decision as to when the student Js ready to take the GEO test is made 

by the GEO teacher in approximately 76 percent of the centers. In the 

remaining centers, a decision is made by the corpsmember, the 



counselori the basic education supervisor, or an.ither individual. For 
the 89 percent of the centers which send stuoeiits to- bth»ir locations to 
take the GEO test, there is no single test location type. Some use the 
facilities of local high schools or colleges, while others use learning 
centers, county education offices, or career centers. There is no way 
to determine how comparable these testing facilities are or whether 
differential conditions affect the test results. 

3. Innovative Materials in the Instruction Program 

Data indicate that the majority of the surveyed centers ara using either 
center-or corporate-developed materials to supplement the standard ed- 
ucational program required by Job Corps national policy. In the area 
of basic education, 84 percent of the centers report that they are using 
such materials, while 67 percent say that they are using them for the 
GEO program. This fact results in an inference that the testing of new 
models should probably be done on an intracenter rather thaw an inter- 
center basis because the education program may vary widely from center 
to center. Approximately 80 percent of the reporting centers state 
that their supplemental materials are vocationally oriented; 83 percent 
of the sampled centers state that they have made changes to the pre- 
scribecl basic education curriculum which they believe are making it more 
effective and efficient. 
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4. Staffing Patterns , ... ' 

Staffing patterns and teacher/student ratios vary from center to 
center. Table 8 presents the teacher/student ratio data. 

TABLE 8 
Teacher/Student Ratios 



Ratio 


Percent of Centers Reportinq 


GEO 


Math 


V 

Reading 


?elow 1:10 


9% 


6% 


6% 


1:10 


14% 


6% 


18% 


1:15 


39% 


47% 


44% 


1:18 1 


17% 


18% 


20% 


1:19 


6% 


0% 


0% 


■ 1:20 


6% 


20% 


9% 


1:25 


. 9% 


• ^% 


3% 



A teacher/student ratio of 1:18 is considered to be the maximum that 
should be evidenced within the Job Corps program. These data show 
that 21 percent of the surveyed center^^ hav^ ratios greater than this 
within GEO; 23 percent in mathematics; ^nd 12 percent in reading. 
This appears jto demonstrate that at least somfe of the centers are 
currently understaffed. i 
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Salary ranges for teachers also differ significantly, with the miflimum 
salary as low as $9,500 and the maximum salary as high as $26,900. 
(for full-year teaching). Data obtained from the teachers as part of 
the attitude questionnaire indicate that teachers are not being , 
comparably paid for experience across centers. There is apparently no 
consistency in salary range or in criteria-fbr salary evident at this 
time. 

Qualifications for teachers also appear to show some variations. 
Ninety percent of the centers reporting state that a bachelor's degree 
Is required; 68. percent report that a state certificate Is necessary; 
and 30 percent sjy that experience is necessary. There are, 
additionally, other differences relating to such things as areas of 
expertise and experience with minority/disadvantaged youth. 
Approximately 92 percent of the centers reporting believe that their 
staff is above average with regard to meeting minimum qualifications, 
.and, yet, 33 percent of the sampled centers feel that minimum teacher 
requirements should be changed, while 67 percent. do not want a 
change. 

Eighty-four percent of the centers report that they do use teacher 
aides in the Basic E ducati o n pro grams, and 81 percent state „tha^Jthey 
use aides in the GED program. However, the type of aide utilized 
varies widely. The majority, 70 percent, are Corpsmembers, while 
others include volunteers, interns, and CETA enrol lees. 
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Qualifications vary from anyone who has completed the Job Corps 
mathematics and reading programs to two years of college. Training 
ranges from noriej to two years of college, to the same training as 
instructors receive. Salary ranges from none to $12,334 per year. 
Only 6 percent of the surveyed centers report that they have a 
vocational training cluster for aides. Again, because of differences 
In both qualifications and training, comparisons relating to the 
yfjinetfoirfng of aides cannot be made on a center- to-center basis. 

5* Accreditation 

Carnegie units or'high school credits that will be accepted by the 
states can be given In only 15 percent of the centers sampled. Only 
three centers report that they are accredited to issue a state high 
school diploma. 

6. Placement Data 

Approximately 63 percent of the centers report that they do keep 
placement data on Corpsmembers other than on Form 72 which is gathered 
on termination; however, the type of data which is maintained appears 
J:o_„vary widely.- Approximately 26 percent of the centers which — 
maintain placement data, keep records for 9-12 months, while 74 
percent keep them longer than 12 months.. Maintenance of follow-up 
data also varie. dramatically. What is seemingly evident from the 
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data also vaHes dramatical ly* What is seemingly evident from the 
data collected»to date is. that there is no consistent procedure 
apparent within the Job Corps for maintaining placement-antf/or 
follow-up data on Corpsmembers beyond the standard termination 
documentation^ 

There are several inferences which can be drawn from the data on the 
Basic Education Director Questionnaire* The first of these is that 
the teacher/student ratios lead one to believe that some centers mdiy 
well be understaffed or are having difficulty filling vacancies* The 
number ^of vacancies vs* authorized slots is a major indicator of this* 
While aides are used in most centers, differential qualifications and 
training imply a lack, of consistent utilization of these individuals 
to reduce teacher/student ratios and increase the one-to-one contact 
so vital to the effective use of programmed materials. 

There is apparently no single totally consistent Basic Education or 
GEO program in use in Job Corps centers. The core program is 

y 

supplemented and adapted in a number' of ways. Additionally, there is 
little consistent placement testing or gain testing procedure in 
evidence within the Job Corps at the present time. Coupled with this 
is the fact that there is no standardized recordkeeping procedure 
currently being utilized that yields the type of data needed on 
V jcational gains to continually update anc improve the program. 
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TEACHER ATTiTUDlTTlllESTIONHAIRE 



The analysis of the Teacher Attitude Questionnaire was based on the 
tabulation of item means and the correlation between the total score 
on the attitude questionnaire and the demographic information which 
WC4 asked. Additional correlations were computed utilizing portions 

of the questionnaire. The calculatlon^of the item means prov ided 

information concerning general attitude on the specific question 
content. Calculation of the correlations provided information on 
whether there was a relationship between attitude and demographic 
dj^a. It was believed that, if there were fairly strong correlations, 
the, demographic data might be used as predictors of attitude. 

Approximately 380 teachers in both contract and conservation centers 
were interviewed during the course of the study. The attitude items 
which were asked, were based on a 5-point Likert scale. On this type 
of scale, the ideal item mean is 3— the point of neutral opinion. If 
the item mean is 3, the inference is that there is a. balanced mix 
between positive and negative attitudes. Only in this in tance can 
the item have maximum potentiajl^tp^i^criminate between persons of 
positive and negative attitudes-, As the item mean departs from 3, 
the Item is less and less capable of discriminating 'between these 
attitudes I \ 



( 



27 



ErJc ' \ 40 



Questions Were designed so that a high total score demonstrated a e: 



positive attitude toward the referent and that* correspondingly, a low 
total score: meant a negative attitude. Using this as an overall 
rationale. It can be seen that an Item with -a mean greater than 3 
shows that people feel positively about the object of the question and 
that an Item mean less than 3. Illustrates that they feel negatively 
about the subject. Scaling of each item took Into account the 
positive or negati ve phraseol ogy of each 'statement. 


the frequency distribution of. total scores for this sample mey be 
found In Chart 1. The shaded portion of the graph includes all of the 
results above the midpoint of the possible score range (i.e., positive 
attitude). This suggests that teacher? have a quite positive attitude 
abogt the Job Corps education program. 

< 

Analysis was* performed on the 100 questionnaires with both the highest 
and lowest total scores (n=200). Consultation with expert 
statisticians and evidence from previous research showed that 
calculations based on a sample of this size are very close to those 
which would be obtained on data from the total available sample. The 
amount of measurement error involved in using this procedure has been 
shown to be very small. Table 9' presents the results which were 
obtained from the sample of 200 teachers. Results broken down into 
regional data may be found in Table 10. As can be seen from the item 
means, the teachers feel that their centers are good places to work 
In and that administrators treat them fairly (items 1 and 4). They 
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qhart 1 ^ 
TEACHER AniTUDE QUESTIONNAIRE 
TOTAL SCORE FREQUENCY DISTRIBUTiON; 



1 I I I 11 I i: I i I I I I I I I I i I I I I I I 

42 41 40 39 3» 37 36 34 33 32 31 30 29 2B 27 26 25 24 23 22 21 20 19 18 



SCORE 
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Teacher Atti tude Questlonnai re 



Item Means 



ITEM 
NUMBcR 


t 

ITEM 


JTEK 

Mr Am 


1 


This center 1$ a good place for a teacher to worK. 


o.ot) 




This job Is interesting and chaTienging. 




3 


> — 

I get enough recognition for the task Tm performing/ 




4 


The c^ntfer adminlsl.rdtlon treats me fairly. 


3.67 


5 


If Job Corps teachers were paid more, they would be 
more effective teachers^ 


2.78 


6 


The materials and learning system which I use are not 
adequate for the task. 


3.03 


7 


There are new materials that could help me do a better 
job In n\y area. 


4.14 


8 


I would like to be able to develop curriculum materials 
on own. V 


4.08 


9 


Working with programmed Instructional materials gets 
boring for a teacher. 


2.78 

( 


10 


The students would be more receptive, depending on what 
I did. 


4.30 




OVERALL 
AVERAGE 




3.70 



.30 

4-i 



TABLE 10 
Teacher Attitude Questionnaire 
' Item Means By Region 



. item' 

NUMBER 


ITEM 


ITEMS MEANS . . 




Region 
3 


Region 
4 


Region 
5 


Region 
6 


Regions 
7 & 8 


TRegion 
9 


Region 

10: . 


.'■Tq^tir'J: 


1 


This center is a good place for a teacher to work. 


3.63 


4.00 


3.61 


3.86 


3.53 


4.10 ; 


4i25' i 

-! ) 


3.85/ 1 


2 


This' job is interesting and challenging. 

> 


4.37 


4.00 . 


4.17 


4.33 


4.21 


4.30 


4,'- 25 




3 ' , 


I get enough recognition for the task Tm 1 

perTOnninq. 


3.21 


3.22 


3.11 


3.28 


3.76 


3.40 


i 


.35 


3r33 . • :■ 


4 


The center administration treats me fairly. 


3.16 


4.05 


3.44 


3.63 


3.41 


3/§0~ 


' 4.10 


:3.67 


5 


If Jpb Corps teachers were paid more, they would 
be more effective teachers. 


2.58 . 


2.72 


1.94 


2.67 


2.9f 


2.50 


3.4O0'' 


2.78 


6 


The materials and. learning system which I use are 
not adequate for the task. 


2.58 


2.83 


3.11 


3.23, 


2.68 


'3.10 


3.25 


3.03 ;• 


7 


There are new materials that could help me do a 
better jiob in n\v area. 


4.00 


4.33 


4.39 


3.74 


4.09 

J 


4.10t 


4. -55 


. 4.14 


8 * 


I would like tb be able to develop curriculum 
materials on mv own. 


4.32 


4.62 


4.22 


4.00 


4.12 


4.10 


3.80 


4.08 


9 


Working with programmed instructional materials 
qets borina for a teacher. 


2.63 


2.44 


3.11 


2.06 


2.38 


3.10 


1 

3.10 

1 

1 


2.78 • 


10 . 


The students would be more receptive depending on 
what I did. 


4.21 


4.39 


4.44 


'4.12 


4.47 ■ 


4.10 


4.35 


4.30 


vm. 




•3.47 


3.66 


3.55 • 


3.57 


3.56 


3.67 


•3.84 


3.62 
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also feel quite strongly that their jobs are both interesting and 
challenging (item 2). Additionally, while their feeling aboqt the 
adequacy, of the existing educational program is basically neutral 
(item 3), they firmly believe that there are new materials which could 
help them to do a better job (item 7). The desire of teachers for new 
educational materials is bolstered by their belief that they can 
successfully influence student motivation (item 10). 

v. 

A correlation coefficient represents a measure of association between 

o 

two things^ The range of the correlation coefficient (Pearson Product 
Moment) is from -1 to +1 with 0 showing no relationship (r= -1<0<+1). 
ThG interpretation of this statistic is that a correlation greater 
•than b (r>0) means that the re/ationship is positive, and a 
correlation less than 0 (r<0) means that the relationship is negative 
or inverse. As the correlation coefficient departs from 0 and gets 
closer to either -1 or +1, the relationship betweeen the two factors 
is said to be stronger. Table 11 contains the relevant correlations 
computed utilizing teacher attitude data. 
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teacher Attitude Correl anions 




CORRELATION 


RESULT 


\ ■ -^^ . ■ ■ 

/ Number of years teaching/total teacher attitude score 

> ■ ■ ■ • , ■ 


-.23 


Number tff years teaching In Job Corps/total teaching 
attitude §core 


-:20 


teaching hours per day/total teacher attitude score 


■ .03 


Salary/total teacher attitude score 


.09 


Teacher- question 5/salary i"or teachers- 


.13 


Average of teacher questions 1,2, and 3/salary 


-.26 


Average of teacher questions 1,2, and 3/number of years 
teaching ^ 


-.23 


Average of teacher questions 1,2, and 3/teaching hours 
per day 


.24 


Average of teacher questions 1,2, and 3/student: teacher 
ratios - 


-.23 


Average yearly cost of education per CMY/teacher overall 
satisfaction with administration 


.22 


Average yearly cost for materials/teacher question- 6 


.18 


Average yearly co^t for materials/teacher question 7 


-.02 


Average yearly cost for materials/average of teacher 
questions 6 and 7 


.14 



1 




Several Interesting conclusions are suggeste.d^by these correlations, 
although in most cases the results are more significant in terms of 
direction than in terms of degree of correlation. / 




1. Satisfaction and attitude toward the Job Corps education 
program declines with length of teaching experience /and tenure fn 
the program. / 



2» Longer teaching hours per day do not undermine satisfaction 
and attitude. In all likelihood, the teachers with less 
.seniority have longer hours, so the more positive views of new 
teachers may be reflected in this correlation. 



4. The more teachers are paid, the more they feel that pay 
increases are required to make Job Corps teachers more effective. 
Satisfaction and attitude are Inversely correlated with salary. 
It may be that salaries do not progress commensurately with * 
seniority, and thi? may t'e the cause of the less favorable 
attitudes of -.sr.lor teachers. On the other hand, negativism may 
be caused by tedium and lack of change, with the negative 
relationship between salary and satisfaction being explained by 
the relationship between tenure and salary. 



3. Teachers are more satisfied and positive when they have fewer 



students and can provide individualized attention. 
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In summary, It can be seen froni these data that, while teachers 

. 1 ~ 

vlev^ the Basic Education and G|ED programs positively, they do 
perceive some weaknesses In them. They do believe that, while 
the existing programs are adequate, there ar^new materials which 
could help them do a better Job. The teachers sampled In this 
study firmly believe that student receptlvenesa to the program is 
dependent on what teachers do and that new materials would 
facilitate this effort. 
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TheXanalysis of the Student Attitude Questionnaire was based on 
the tabulation of item ineans and the correlation between the 
total xscore on the questionnaire and the demographic irtformation 
which vias asked* In additionv correlations were computed 
utilizing relevant portions oj; the attitude questionnaire* The 
calculav^on of the item means provided information concerning 
general attitude on the specific question content* The 



calculation of the. correlations provided information as to 
whether therie was a relationship between attitude and specified 
demographic da^a. It was believed that, if there was a fairly 
strong correlation, the demographic data might be used as a 
predictor of attitude. 



Approximately 8Q0 Corpsmembers in both contract and conservation 
centers were interviewed during the course 'of the study. The 
frequency distribution of the total scores for this sample may be 
found in Chart 2. The shaded portion of the graph includes all 
Corpsmembers whose total score on the attitude questionnaire was 
above the midpoint of the possible score range (illustrating 
positive attitude). The ^analysis was performed on the 100 
questionnaires with the highest total score and the 100 
questionnaires with the lowest total score (n=200). The general 
consensus is that there would be very little additional 
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; V - 

s - 

«. " _ ' 


Masurement error Inyblved In using this procedure rather than total 

1' ' - ' ' ^ ' , . . 




^- \ 


saMpte analys1s^ the 1,tem means which were obtained from the 


f 


i' * * 


iConpsmember sample were very encouraging (Table 12, regional breakdown 


\ 


r *- - ' » 


maiy be found In Table 13) • The students appear to have a very 




< * 


positive attitude toward the Job Corps Basic Education and GEO * - 




* ' * c - 


^ 'programs. ' . 
Corpsmembers feel that something -should be done to make reading and 


c *. 


i 


mathematics more Interesting. Th?s Independent assessment agrees with 


i 




the belief of the teatchers that, although the basic materials are 


4 ^ ? 




adequate, there are new materials which could be better. In addition, 
Corpsmembers seem to feel, as evidenced by comments^ that programmed 


* 


it 

\ 


instruction tends to get boring. Thl5: supports the use of 


• 




supplemental learning aids. , 






What should be noted Is that, for the sampled concepts, the Job Corps 






Student likes what Is |iappen1ng. He feels that teachers are treating 


' i 




him fairly (Item 6), that he Is getting enough attention In class 


* * 




(IteiiJ 5), that his teachers are friends (Item 7), and that, above all. 






he Is being respected as a person (Item 8). Thus, In the eyes of the 




> 


students, the teachers are performing far above an average level In 




■■• •' 


these areasv 






, ^the Pearson Product Moment Correlations Coefficient, which was the 


\ 


< 


statistic utilized for this analysis, determines the strength of 
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TABLE 12" ' 
Student Attitude Questionnaire . 
Item Means 



ITEM 
. NUMBER 


■■ 'ITEM . 


ITEM 
MEAN 


1 


Joh CorDS Is olvinQ me a. chance of an education 
that r couldn't get any other way. 


3.56 


- 2 


The education classes here are inore interestina 
than when I went to school back home. 


3.27 


• " 3.. 


I -learn more here than I did In school. 


3.59 


4 ' 


•> * 
I wish they would- do. something to make reading 
and math more interestlna. 


3 54 


5 


My teachers give me enough Individual. attention 
In class. 

Ill W 1 ^ • 


3.63 

W • WW 




- I am treated fairly by my basic education or 
GED teachers. ' 

Wt»l/ VWMWSlWl Q 


4. 04 


7 


I consider my teachers as friends here. 


3.97 


8 


* My teachers respect me as a pferson. 

9 

•• 


4.04 


9 


the peof>le who go home from Job Corps early do . 
so because the classes are too dull. 


3.67 


10 


The education program Is nothing like what I,, 
was told It would be In my orientation. 


• 3.13 


OVERALL 
AVERAGE 




3.65 
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' - student Attitude Questionnaire 
Item Means by Region 



ITEM 
NUfffiER 


ITEM 








- , ITEM MEANS , 


t 






Kegion 

3 . 


Kegion 
4 


Kegion 
5 


Region 

6, 


Kegions 
7 & 8 


Region 
9 


Region 
10 • 


TotaT 


1 


Job Corps is giving me a chance of an education " 
that i couldn't get any other way. 


3.68 


3.06 


3.46 


3.89 


3.50 


3.80 


3.24 


. 3.5'6 ■: 


o 

C 


The education classes here are more interesting 
than when I went to school back hqme. 


3.58 


2.53 


3.46 


3.49 


3.19 


3.70 


3.00 ■ 


3.27 ■ 


o 


I learn- more here than I did in school 


3.58 


2.82 


3.77 


3.74 


3.62 


3.80 


3.88 


3.59 


A 
*t 


1 Wish they would do something to make reading 
and math more interesting. 


3.26 


3.85 


3.46 


3.66 


3.33' 


3.50 


3.59 


3.54. 




My teachers give me enough individual attention 


3.53 


3.29 


3.85 


3.72 - 


3.76 


3.90 


3.41 


.3.63 




1 am treated fairly by my Basic Education or GED 
teachers. 


4.2b 


3.79 


4.15 


4.02 


4.07 


4.10 


4.12 


4.04 


7 


1 consi aer my teachers as friends here. 


4.00 


3'i68 


3.85 


4.09 


4 21 


4.00 • 


3.59 


3.97 


8 


My teachers respect me as a person. 


4.16 


3.91 


4.31 


4.17 


3.93 


4.10 


3.71 


4.D4 


9 


The people who go home from Job Corps early do 
so because the classes are too dull. 


3.89 


3.26 


3.69 


3.85 


3.74 


3.50 


3.41 


3.67 


10 


The education program is nothing like what I was 
told it would be in my orientation. 


3.32 


2.56 


3.31 


3.36 


3.26 


3.30 


3.18 


3.13 


OVERALL 
AVERAGE 




3.73 


3.28 


3.73 


3.80 


3.66 


3.77 


3.51 


3.65 



,a;2so'iation between two things. The.-range of the Pearson, r is from-1 
to +1» with 0 showing no relationship (p=1<0<=1). However, it should 
be noted that this statistic is accurate only for linear data. The 
correlations for Corpsmembers interviewed in this study are presented 
in Table 14. 

TABLE 14 
Student Attitude Correlations 



Correlation 


Result 


Months in Job Corps/total attitude score 


.04 


Age/total attitude score 


.02 


Enrollment in Basic Education or GED/total 
attitude score ' = 


.27 


Last grade attended/ total attitude score 


.11 


Student question 5/student: teacher ratio by center 


-.58 


Average yearly cost for materials/student quest. 4 


-.28 


Teacher overall satisfaction by center (quests. 1-4) 
Student overall satisfaction by center (quests. 1-3) 


.10 
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Several, insights are suggested N correlations: , 

I 

1. There is no significant, relationship between months in Job 



Corps and attitude or between Corpsmember agpand attitude. Thus, 
perceptions about the Job Corps education program do not change, 
at least While the student is in the program* 

2,. Students notice and feel they benefit from individualized 
attention when the number of students per teacher is reduced* 

3* Students are more satisfied with materials when expenditures 
'for materials increaS^e. ^ 

4* In centers where teachers tend to be more satisfied and have 
positive attitudes, students also seem to share this positivism. 

5. Youth who are in the GEO program are more positive about 
educational offerings than those in Basic Education, 
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SAMPLED CENTERS 
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CENTERS WHERE INTERVIEWS WERE CONDUCTED 



Region Center 



III Blue Ridge 

Charleston 
Keystone 

Maryland (Woodstock) 



IV * Atlanta 

Breckinridge 
Crystal Springs 
Jacobs treek 
Lyndon Johnson 
Oconaluftee 
Schenck 
Whitney Young 



Cincinnati 
Cleveland 
Detroit 
Golconda 



Cass 
El Paso 
Gary 
Guthrie 
McKlnney 
Quachlta 
Treasure Lake 
Tul sa 



Clearfield 
Coll bran 

Excelsior Spring 
Kicking Horse 
Mingo 

Pine Ridge 
Weber Basin 



VI 



VII and VIII 
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Center 



IX 



PhoehiA 
San Jose 
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Angell 
Ft. Simcoe 
Portland 
Timber Lake 
Tongue Point 
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CHAPTER 3. SELECTION OF EDUCATIONAL MODELS 



The aim of the EIE Is to test under controlled conditions the most * 
promising models for educating economically disadvantaged youth; 

Selection criteria were developed' from the unique? needs and character- 

' i * 1 \ I 

istics of th^ Job Corps population* Th^ following criteria wet^e ap- 
plied to select programs which would meet those needs and be ta|ilored 
to the; subject population: 



1 . Materials , and/or Techniques Geared for Adults 



\ 1 [ ' \ 

There, are many ^innovative, effective and interesting educational mate- 
rials and techniques;* however, the vast majority have been develop^^d 
in the schools f oir a pritnary or secondary Uhool-age population. \ 
Particularly in the cases of materials desiVed for very early instriic 
tion {very low Skill levels) the format, teX;t, and illustrations are , 
frequently juven^l,^ and, as such, are regarded as^ insulting, boring, 
or inappropriate by Corpsmembers. To alleviate these problems, models 
have been sought which appear to be directed to adults, both in style 
and content. 



2. Instructional Materials of Diverse Appeal 

* 

Care has been taken that model materials have sufficient diversity or 
generality to elicit high interest from either males or females,, and 
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that illustrations depict various racial and ethnic groups and males 

and females in diverse situations, , Content should -include cultural 

awareness subjects as well as women and men in non-traditional careers 

all' groups should be depicted positions of authority. In general, 

material was sought which would be neither sexist not racist, either 

by' intent or omission and would present positive Image i/ith which 

♦ 

Corpsmembers could identify. 

3 . Very Low Level Reading and Mathematics Instruction 

Job Corps enrol lees must be served at whatever level of capability 
with which they enter. Therefore, materials were sought which would 
aid the Corpsmember who could not read at all and had not previously 
acquired any mathematical skills. , The chief difficulty^ in this search 
was to identify materials which, though they had to be at very low^ 
levels,, were still adult in content and format. Frequently those 
materials designed for adult education begin at a third or fourth 
grade level; approximately one-third of entering Corpsmembers are he- 
low those levels, 

4. Open Entry/ Exit 

Job Corps input is on a weekly basis, and Corpsmembers are free to 
leave whenever they feel^ they have reached their goals or feel "the 
program is not meeting their needs. Thus, an instructional program 
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must not defend upon the students* having to begin at a speciyic time 
In a school term^ nor must the program require that a fixed time be de- 
voted to It before the enroll ee'obtatns^ results. 



5« Individualized 



Corpsmombers , as noted above, enter' at different times, with very dif- 
ferent skill levels, and, progress at very different rates. Job Corps 
educational programs must be Individualized: open entry/exit, self- 
paced, and available at many levels to accommodate the special needs of 
each Corpsmember, so that a Corpsmember can work alone or In a small 
group. 

6. Programs Available In Spanish 



Job Corps must serve bilingual Corpsmembers at all skill levels; i.e., 
those who cannot read In any language although fluent In both; those 
who can read In Spanish, but. not English and those whose fluency Is 
much greater in Spanish, although they may not read it. In certain ■ 
cases, it may be appropriate to place the Corpsmember directly into an 
English language and reading prog/am; in other cases it may be more ap- 
propriate to begin with a Spanish/ language and reading program. Also, 
Implementation of Spanish programs aids cultural awareness and recogni- 
tion for all Corpsmembers. I 
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?• Preferred. Coiflprehenslve Progriims 

While high-quality programs In either reading or mathematics were se- 
lected In some cases. In general , j programs whtch would provide a com- 
-pTete-basIc education curriculum Were preferred. There are several 
reasons for this. First, a well-ilntegrated program, one where aM ele- 
meiits contributed to success In each area, was d6sired; thus, a com- 
pleted program designed by a single developer was ^thought to be more 
likely to accomplish this. Second, evaluation coinparabll Ity with other 
-programs was more likely If each had the sane emphasis. Third, Imple- 
mentation was easier If a package could be put In place as a whole, 
and material* and training could be coordinated by the developer. 

r 

8. Preferred Programs-wlth Diploma Potential 

Research has shown that a credential (high school diploma or GEO certi- 
ficate) is one of .the most valuable results that can be obtained from 
Job Corps. However, since a GEO is riot based upon previous high school 
work completed, it may take longer for a Corpsmember to obtain a' GEO 
than a diploma. If a model program gives credit based upon previous 
work completed, a student may be able to obtain "the remaining credits 
in the program, thus, receiving a regular high school diploma. Job 
Corps would then also have a"*iniean3 of recognizing younger Corpsmember.'s 
achievements, since in many cases the student must be 18 in order to 
earn a GEO. In the case of a diploma, however, younger Corpsmembers 4» 
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could earn their credential before -leaving Job Corps, an important 
factor in job placement. 

In addition to the above eight criteria, there were several more ob- 
vious ones. Foremost among these was that programs were selected for 
general high quality appearance, sophistication of technique, recogni- 
tion and incorporation of solid educational theory, and professional 
'and well-designed materia.ls. Also rating as very important was the , 
developer^s capacity to produce the requisite tr^iprers and/or materials 
to meet imrylementat ion dates. For many educational programs, Job Corps 
has many more participants and'requires much quicker start-up than many 
developers usually experience. 

Since Job Corps wanted, to avoid reinventing the wheel, several agencies 
were contacted in an effort to identify programs which had been used 
successfully elsewhere, even if only on a limited experimental basis^. 

Contact v^as first established with the Education -Division, Department 
of Health, Education and- Welfare (HEW). The Educational Improvement 
Effort (EIE) was discussed with a range of experts in the Bureau of 
Elementary & Secondary Education and the National Institute of Educa- 
tion (NIE). 

The Education Division of HEW has established a Joint Dissemination 
Review Panel (JDRP) to review programs submitted to them for efficacy 
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and reliability of evaluation. If the panel approves the programs, the 
program becomes part of the National Diffusion Network (NDN) Is includ- 
ed In its directory. Educational Programs that Work , and is eligible 
for funds to disseminate Hs methods and materials. Thus, although 
many of NDN's programs do not meet our criteria, those that do were in- 
vestlgated for quality and replicability. 

In addition to the Department of HEW, resources already existing in * 
Job Corps were tapped. Several planning conferences were conducted. 
Besides providing feedback on proposed inodels generated by the above 
two methods, center personnel and consultants also suggested education- 
al programs of which they were aware and with which they were impressed. 
Also,^some center personnels recommended consideration of, programs which 
were already being used on an experimental basis at some Job Corps cen- 
ters.. At least one model was suggested by Job Corps national office 
personnel . - - 

Several program developers approached Job Corps^on their own initiative^ 
These programs were subject to the same investigation as programs iden- 
tified in other ways, TEAM Associates, the contractor for EIE, had 
been responsible for developir^g one of the models, 

c 

} 

The following* chart lists the major programs which were considered for 
inclusion in Phase 1 in the EIE, how they were identified, whether they 
were selected as final models, and, if not, why not? 
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POTENTIAL MODEL SELECTION 



MODEL HOS 


IDENTIFIED SELECTED? 


WHY -NOT? 


uXpericFlCc DaScQ 

Career Education 
Northwest Regional 
Education Laboratories 


fIDN 

r' 
1 

t 
I 


No 


«• 

V 

Ttrinl otTion + ;< t^nn 
iiiip 1 CkIcii tatiuii at 

rural sites would 
be so difficult as 
to preclude its 
implementation Job 

r pb W 1 uc • 


Individualized Learn- 
ing for Adults -Re- 
search for Better 
ocnoo 1 s 


NDN 


No 


Rejected by confer- 
ence participants 
because of Icw-in- 

tcicot ITIatcrialb* 


Classmate 88 


Recommended by 
uetroix ana wooa 
stock Job Corps 
Centers 






Computer Curri- 
culum Corporation 


Recommended by 
Job Corps con- 
sultant 




Other computer 
curriculum judged 
to be more intwest- 
ing, - _ 


hxperimenta i uenter 
for Reading Instruc- 
tion (ECRI) 


NDN 


No 


Ma^HaHc f\n 1 \.* 
nctilOUo UlMjr 

appropriate for 
children; not open. 
entry /exit\ no\ suf- 
ficiently individua- 
lized. 


Vocational Reading 

ruwci 


NDN 


No 


Material not compre- 
hensive enough to 
substitute for en- 
'tire basic skills 
curriculum. Retained 
for possible future 
use« 
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POTENTIAL MODEL SELECTION 
(Continued) 



^ODEL HOW 


IDENTIFIED 


SELECTED? 


WHY NOT? 


Learning to Read 


NDN 

- 


No 

• 


Of interest pri- 
, marily to males; 
no maxn component; 
poor quality re- 
production' of 
materials-. 


Individualized 
Language Arts 


NDN 


No 


Contact person 
never returned, 
numerous calls. 


Project Positive 
attitude Toward 
Lsarnina 


NDN 


No 




Systematic Teaching 
and Measuring Mathe- 

[natics 


NDN 


No 


Too juvenile. 


• 

Adult performance 
Level Project 


NDN 


Yes 




Computer Assisted 
Instruction/Uni V 
3f San Francisco 


Recommended , 
sultant 


Yes 




Help One Student 
to Succeed (HOSTS) 


NDN 


No 


Decided to use 
existing Job Corps 
resources to tram 
and provide same 
type of program 


Cambridge Publish- 
ing Co. GEO Pro- 
gram 


Suggested by 
Job Corps Edu- 
cation Specia- 
list 


Yes 




Adkins Life Skills 


Office of Edu- 
cation 


Yes 




Staffing Model/ 
Peer Aides 


Developed by 
TEAM Associ- 
ates 


Yes 




New Reading 
Program 


Developed by 
. TEAM Associ- 
ates 


Yes 
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POTENTIAL MODEL SELECTION 
(Continued) 



MODEL 


HOW IDENTIFIED 


SELECTED? 


WHY NOT? 


Control Data 
Corporation/ 
PLATO 


Job Corps approach- 
ed by CDC 


No 


Program Library 
of courseware not 
sufficient 


University of 

Illinois/ 

PLATO 


Job Corps approach- 
' ed University of 
Illinois 


Yes 




Math Program/ 
CEMREL 


Recommended by 
former Job Corps 
Director 


No 


Not comprehensive 
enough. 
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As can be seen^frdni the chart, this search yielded eight programs: 
one selected fr(»n the NDN, two developed by TEAM Associates, two 
recommended by^ individual Job Corps centers, one where the developer 
approached Job Corps, one recommended by the Office of Education, 
and one recommended by a Job Corps education specialist. 

These eight models were selected because, in addition to substantially 
meeting the previously mentioned criteria, they also covered the entire 
spectrum of desired revisions, were innovative in their areas, and, in 
general, were quite different from both the regular Job Corps program 
and from the average public school programs. 

In addition to these eight Tnodels, four others are included in the EIE 
study and are described in the foil owl nq pages. With the exception of 
API, these latter models were developed based on several procv^ammati c 
needs within an expanded Job Corps program. 

In Phase II of EIE, models for bilingual education for-^Hispanics were 
carefully reviewed by-the'^same criteria. Experts in Job Corps, HEW,, 
and the Department of Defense were consulted. Likewise, a conference 
format was utilized to select models for identifying and treating Corps- 
members with learning disabilities. Detailed below are model program 
descriptions selected for the Educational Improvement Effort Program. 
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1. Adkin^.-Emplovability Skills Series 

•Th9 Adkins Employability Skills program is a model developed by 
Dr. Winthrop R. Adkins, Associate Professor of Psychology and Educa- 
tion at Teacher's College University. The Employability program is a 
series of ten problem-centered,- predesigned units on selecting, finding 
and keeping a job. The overall purpose of the program is to help the 
student learn to cope successfully in a rapidly changing environment 
and to ensure that he can make use of resources available to him. 

This model is currently being implemented in 130 locations throughout 
the country and in many CETMr^grams. It was designed for use by the 
.economically and socially disadvantaged. In brief, it is a structured 
program requiring the student to demonstrate specific competencTes 

The structured learning experiences in every program unit follows a 
four-stage model designed to foster behavioral change by engaging the 
student in self-analysis, goal-setting, and experimental activity. 
Stage One is the stimulus phase, designed to frame the pj:;oblem and to 
create readiness to discuss it. The Employability Skills prograir-^ , 
makes use of emotionally powerful videotape recordings to arouse 
student interest in the unit. In Stage Two,. the evocation phase, 
students are actively involved in defining the problem; students see 
that their ijiput and experience in coping with the problems is impor- 
tant. The key here is learner involvement. In allowing the learner 
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to name the -problem and to participate in planning a learning strategy, 
he is more likely to accept the learning as relevant and thus, generate 
the self-motivation needed to reach his goal. In Stage Three, the 
. objective inquiry phase, the students explore the world of work, ob- 
jtaining information on a particular question from a variety of sources. 
Multimedia kits, which contain predesigned materials, also suggest ways 
for the student to utilize community resources. , 

The final stage, the application phase, is designed to ensure that 
' students are required to demonstrate competence in performing the ob- 
jectives set forth in that unit. 

The Adkins model offers a balance between structure and freedom; the 
student is actively involved in the learning process and must take 
much of the responsibility for his own learning. At the same time, 
the program is structured enough so that students are given adequate 
guidance and direction. 

This program includes an application phase in its design to help ensure 
carry-over of learning. The desired outcome is that knowledge and 
awareness gained during the stimulus, evocation, and objective inquiry 
stages will be translated into specific behaviors during the last 
stage of the learning cycle. Using this approach, world of work 
students are given opportunities to practice skills and behaviors 
they have learned, just as they do in vocational courses. Further, 
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the Adkins model provides the. student with more reinforcement then is 

contained in the present program. The peer group is used to provide 

/ 

feedback to the learner. Students gain the benefits of structure^ 
- group and individualized instruction; they have a laboratory ^grpup so 
that they can test and practice skills and behaviors. 

This model also incorporates full use of community resources to pre- 
pare the Corpsmember to function adequately in daily life(. since the 
world of work is that world outside the classroom and the prepared 
tapes and kits. In order to conduct a relevant program, Corpsmembers 
need to experience contact with working adults i 

Finally, the Adkins model provides the students with a structured, yet 
very positive, growth- oriented experience. Planning and decision- 
making skills are included as part of the curriculum to ensure that 
the Corpsmember is exposed to a method of making choices that will 
affect his/her life. Wf)fen the Corpsmember leaves Job Corps, he/she 
may change ^bs and even careers several times during his/her adult 
years. He/she needs a frame of reference to use to enable the 
structuring of alternatives, to see the consequences of choices, and 
to make satisfactory choices. 

2. American Preparatory Institute (API) 

/ 

API is a competenqy-based, open entry/exit system built upon self-paced 

/ 
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instructional modules. To provide for a variety of training needs, API 
had developed a complete competency-based instructional and training 
system that is responsive to the needs of adult students. These 
/students are seeking to develop and/or strengthen basic skills neces- 
I sary for daily living, job advancement or preparation for further 
training, preparation for continued education, completion of a high 
school education and development or expansion of vocational and occu- 
pational competency, ko meet each of the above needs, the training 
system consists of various program options that will result ini 

• Basic Skills /Development 

• Certificate of High School Equivalency (GED) 

• Dev^''opment^l or Expansion of Vocational and Occupational 
Skills 



Within each of th|6 program options, the courses are based upon a well 
defined set of cdmpetencies to be mastered for/ course completion. 
These competencies represent the desire behaviors that adults must 
possess to be functional in the "real world."/ These competencies were 
isolated from various studies including the nationwide Adult Perfor- 
marice Level (APL) project conducted by the University of Texas, Austin, 
Texas. American Preparatory Institute was ythe first school to inte- 
grate the APL competencies into an accredited adult school program. 
Since the emphasis on the various program options is on skills mastery 
or proficiency, a trainee can demonstrate prior competence and advance 
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to the next skill level. This c^jmpetence is demonstrated by documen- 
tatlon of prior knowledge, experience, or training and through criterion 
pretesting and posttesting. Thus, a trainee demonstrates skills mastery 
for course completion and is not required to attend any specific course 
for a fixed time period. 

The basic skills development program incorporates adult functional 
coping skills in its content. Placement consists of a diagnostic pre- 
test whose items are referenced %o specific skills, ^with functioning 
and frustration levels. 

The GED program reviews fundamentals taught in the basic skills pro- 
gram, or learned prior to entry into Job Corps. The GED program pro- 
vides instruction in developmental mathematics, developmental commu- 
nications, developmental reading, developmental science, and develop- 
mental social studies. Reading skilU are emphasized throughout all 
classes. 

3. Adult Performance .level (API ) 

The developers of the program, the University of Texas at Austin, sur- 
veyed the capabilities of adults throughout the country and found that 
certain skills were necessary to function in public life. These skills 
were subdivided into five categories: community resources, health, 
government and law, consumer economics, and occupational knowledge. 
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Trom these categories, modules were developed to enable students to 
gain the competencies they needed (For example: modules teach such 
things as how to find the correct bus route, get a driver's license, 
fill out income tax forms, or get food stamps). Not' only are students 
taught these coping skills, but through performing the tasks, students 
also learn basic reading, language and computational skills. 

Students are placed in the program through the APL survey instrument 
and are assessed for competencies by the contc-nt area measures designed 
for the above-mentioned five categories. The developer arranges with 
the local school board to grant a competency-based school diploma to 
those who successfully complete the APL program, APL is a total com- 
prehensive program that can take students from" elemontary competency 
levels through high school levels, 

4- Bilingual /English as a Second Language (ESL ) 

To supplement and contrast with the standard Job Corps ESL materials, 
screening resulted in the selection of the Defense Language Institute 
(DLJ) audiolingual program. Two levels of DLI, the pre-elementary and 
the elementary, will be used. Under this model, the enrollee is com- 
pletely enmeshed in the new language and no translatea ...aterial is 
presented. 

The bilingual approach of Hispanic enrollees simply translates standard 
Job Corps educational an J vocational materials for use by enrollees 
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and employs bilingual aids and Instructors. The bilingual approach 
/ has an ESL component and the use of translated materials decreases as 
the enrollee's English capability Increases. 

5. Computer Assisted Instruction (CAI)/University of Illinois PLATO 

The University of Illinois PLATO project has developed a computerized 
system that contains several thousand hours of courseware in over 80 
separate subject areas. The PLATO Education Group has put together 
a selected package from this vast library, based on their previous 
experience, which can be used in conjunction with the Job Corps reading, 
mathematics, and 6ED programs. 

students work at Individual terminals on PLATO lessons that are cor-' 
related with their regular Job Corps work. Two periods of each da^y 
are set aside for reading classes, two for mathematics, two for 6ED, 
and one period Is used for remedial 6ED work. During the last period, 
students come to the PLATO lab on a teacher referral basis If they are 
unable to progress In one area In the regular classroom or If they have 
taken, but not passed the GEO test. 

PLATO incorporates innovative features in jts hardware (such as the 
capability for students to make responses by totiching the terminal 
screen) and uses these features in its software prog.^am design. In 
addition, PLATO keeps a continuous record of the student's time spent 
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working and progress made. Finally, many lessons on -PLATO are designed 
With extensive remedial branching so that students can get continuously 
varied practice in areas where they are experiencing difficulty. 

6. CAI/CMI University of San Francisco/TEAH ^ 

This program was developed by the University of San Francisco and 
modified by TEAM Associates, Inc., to meet Job Corps requirements. 
The program consists of a combination of both computer-assisted (CAI) 
and computer-managed -Instruction (CMI) with the emphasis on CMI. 

The current computer-managed reading program provides an individualized 
prescription for each student dependent upon the student's performance 
on criterion-referenced diagnostic and posttest. The computer-managed 
system also maintains student records in reading and math areas, making 
all information on students easily available to teachers and administra- 
tors. 



The computer-assisted mathematics pr.ogram uses student-operated termi- 
nals connected to a mainframe computer, which "is programmed with as- \ 
sorted mathematics drill and practice programs designed tlo Improve \ 
student skills. The computer iscaoable of giving Instant feedback 
and continuously monitoring student progress. 

A' combination computer-assisted and computer-mapaged instructional 
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system is currently in use in the world of work program. 

7. ' Modified CAI/CMI - , • 

V 

t 

The computerized education system just described will be expanded and 
modified to include complete CMI and CAI programs in reading, mathe- 
matics, 6ED and world of work. The University of Illinois PLATO system 

will also be incorporated as the basis of the CAI component. 

> * 

The total computerized system will serve as a supplement to the regular 
Job Corps paper/pencil program in all four subject areas. Students , 
will« follow the normal Job Corps curriculum using the regular materials. 
However,, PLATO and other CAI lessons will be available if the teachers 
feel that particular students would profit from this mode of instruction 
or remediation. ^ - ^ 

All education areas except world of work will operate on a diagnostic/ 
prescriptive format that is managed by the computer. Tests will be ^ 
scored by an optical scanner with the rjesults being fed dvrectly into 
the computer. A student matrix will be generated by the computer which 
allow students, teachers, and administrators^ to see which objectives 
students have completed, and which objectives remain to be completed. 

8. CAI Math 

Th^ystem consists of a math skill drill computer, which resembles a 
/ 64 . ' 



4esk calculator, an instructor's guide, flowchart instructions for each 
drill, and a skill listing describing available programs. To operate 
Classmate 88, the student (or teacher) selects a drill for the skills 
area in which he/she needs practice, and consults the appropriate 
flowchart, which will detail the sequence of keys which need to be 
pressed to get the proper drtll* The Classmate 98 then presents pro- 
blems testing the requested skills. The student' works the problem 
with paper and pencil, then punches the answer on Classmate 88. 

If the student has made an error, the machine prints "E", then waits 

for another answer; if, after three tr1el\ the' student has not solved 

the problem correctly, he/she can see the correct answer by pushing 

a specific key. The print-out tape notes the he/she has done this. 

As soon as the correct answer found (either by the student or by 

< 

the machine), a new. problem is generated. 

Besides generating problems for individual practice, the teacher can 

V 

yse the machine to generate a specific number of problems, either with 
or without answers, and use these as homework, thus alleviating the 
problem of thinking up routine drills. 

9- Cambridge GED 

The Cambridge GED program provides a multimedia alternative to the 

> 

regular Job Corps curriculum. Cambridge GED Is based upon video/audio 
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cassettes which teach individual lessons via lecture and example^ 
coupled with a- student workbook which provides supplementary drill for 

the content taught in the video presentation. This study will seek to 

*■ ' - \ 

determine whether this is a higher quality program than the Job Corps 

\ 

GED, v/hether it is more motivating for Corpsmembers, and whether or i^ot 
it induces better scoreJi and more rapid acquisition of a GED certificate- 

Each Corpsmember is initially administered a practice pretast in a given y 
subject area to determine instructional needs. Following a period of 
prescribed study, a posttest is given. Since the program is administered 
through self-paced individualized instruction, a high level of class- 
room manag^nt is required. Coordination with the state testing and ^ 
certifying agency is necessary to ensure timely testing following the 
period of preparation. 

IQ. Learning Disabilities 

TKis model contains two programs designed to identify Ccrpsmembers with 
learni.ng disabilities and to provide remediation and/or compensation 

J 

skills intended to assi5;t the students in overcoming their disabilities. 

Extensive >^esearch wat conducted by TEAM Associates, Inc., to ascertain 
programs that could serve the Job Corps population with learning dis- 
abilities. The research concentrated on non-medical models with 



66 



intervention strategies which could be implemented by the regular Job 
Corps classroom teachers. In addition, programs which would keep 
identified individuals mains treamed within the Jod uorps ^program were 
desired so as not to introduce the psychological effects of isolating , 
Corpsmembers. Two programs meeting these criteria in addition to 
regular Job Corps program criteria were identified, one developed by 
'the University of Florida and one by the University of Kansas. 

11. New Reading Program 

J 

Due to the large number of out-of-print, outdated, and unavailable 
materials in the existing Job Corps j^eading program, a complete update 
and revision of the program was undertaken. 

The revised program closely follows the principle and design of the 
former reading program. It is based on an open-entry, open-exit indi- 
vidualized approach. Students with reading levels from illiteracy to 
grade level 10.0, are assigned into one of the three reading sections- 
beginning, graded, or advanced. 

The beginning reading program uses the Sullivan Associates Programmed 
Reading System. The graded and advanced classes utilize nearly 3,000 
selections from 20 different reading kits and series. These selections 
are the core of the graded and advanced systems • Students increase 
their reading level by reading selections and answering several^ 
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"tornpreReristOQ^uesti ons on each selection. These materials wen care- 
fully selected to^c^er a. wide range of topics that are of interest to 
young adults. Particular eftphasis was-pjaced oh selecting materials 
on vocations and vocational training, minorities ayid-women,m 
vival" skills. Integrated into this developmental sequence are 
language/?tudy skills strand, a specific skills strand, and a supple- 
mentary and special use strand. 

12. Staffing -....^ 



The model utilizes carefully selected and trained Corpsmembers as^teach^ 
aides in several reading classes. The a.des will initially take respon- 
sibility for correcting papers, doing simple recordkeeping, filing and 
other routine duties. The shifting of these duties fnom--the^:eacher to 
the aides hopefully, will ^llow the teacher to spencl^mace^time on actual 
instructions. Aides are also used in working with individuals or^jriall 
groups, providing assistance or instruction if necessary. The experimental 
model calls for teachers to work with an aide for half the day. The 
same teachers work without an aide for the other half of the day. Com- 
parisons of reading gains are made of classes in which the teacher has 
an aide as opposed tajhose in which the teacher works alone. In addition 
to these objective measures, there-are subjective evaluations based on 
interviews w administrators, teachers, Corpsmembers, and aides to help 
'determine the feasibility of more widespread use of the model in Job Corps. 
Observations of increased one-to-one teacher time will be verified and 
documented by the monitors. 
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CHART 4 
EIE PROvlECT SCHEME 
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Adklns, Cohort 1 N-60 
AdMns, Cohort 2 N«30 
M>I, Cohort 1 N-270 
Cohort 2 N"270 
APL. Cohort 1 N« 40 

APL, Cohort 2 N« 50 

6111ngu«1/ESL, Cohort Y N«200 
6111ngu«1/ESL, Cohort 2 N«200" 
CAI/dll, Cohort 1 N«75 
CAI/CHU Cohort 2 N-75 
CAI/CNU Cohort 3 N«75 
CAI/PLATO. Cohort 1 N«96 
CAI/PLATO; Cohort 2 N«96 
CAI/PLA>Ot Cohort 3 N«96 

CA:/CNI/PLAT0» cohort 1 N>300 

CAI/CNI/PLATO, Cohort 2 N«300 

CAI/CMI/PLATO, Cohort 3 H-300 
CAI Hath, Cohort 1 N«150 

Caatrldge GEO, Cuhort 1 N«110 

Cambridge GEO, Cohort 2 H«150 
L.O.^ Cohort 1 N-100 
NRP, Coho*"t 1 N«825 
MRP, Cohort 2 N«670 
SUffIng, Cohort 1 N"415 
Staffing, Cohort 2 N«550 
Staffing, Cohort 3 N«550 
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CHAPTER 4* RESEARCH Arip. DEyEi.OPMENT 
Design for EIE Models 

Under the EIE research and experimeptal design, each of the identified 
models will be implemented in one or more Job Corps centers. Corps- 
members will be randomly assigned to a model program in an existing 
Job Corps component and the comparative programs will be tracked. 
There are variables in the design for specific models to address 
their special features. Entering corpsmembsrs--wt^^ run through 
the experiemntal andjtontretTtfoHeTs, The noted sample sizes, pertain 
to the first cohort only. 
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ADKINS EMPLOYABILITY' SKILLS SERIES 

Purpose: To ascertain if this muUi-media approach to teaching em- 
ployability skills produces more knowledge than that obtained from 
the traditional Job Corp: World of Work program. 

Sites: Pittsburgh (250) 
Woodstock (430) 

Design: One experimental cell (Adkins) and one Job Corps' world-of- 
work cell per site. 

Methodology: Incoming corpsmembers will Lc pretested using RJSl. 
Those Corpsmembers who score highly enough on RJSl to be placed in 
graded reading according to the center's normal procedure will be 
randomly assigned to either cell of the design. The reading-level 
constraint is essential because of the level of both the Adkins 
materials aru- the evaluation instruments. No student being tracked 
for this model should be involved in any other model. All students 
will then be pretested using the Reading Comprehension and Mathema- 
tics Computation subtests pf the Stanford Achievement Test, Form A. 
Additionally, ctudetits will be pretested using Form 1 of the com- 
bined ACT test which was developed for use in this evaluation. 
Students will then follow the curricula designated by the appropriate 
programs. After 90 instructional hours, all students will be post- 
tested using alternate forms of the above mentioned instrumentation. 
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Hypothesis: It is believed that the multi -media approach of Adkins 
will result in the gain of more occupational knowledge than will the * 
traditional Job Corps program. However, it is felt that the trans- 
fer of learning to reading and mathematics will be equal across both 
programs. It is further believed that modifications to the Adkins 
program as delieneated by the developer will have to be made in order 
to make the program feasible for use in Job Corps. 

Analysis: The analysis of reading and mathematics gains will be the 
same as for other programs. A 2 sample ttest will be the method of 
analysis for the ACT test. 

Sample: 



Pittsburgh 


Woodstock 


30 


30 



Experimental Sample: 60 

Total Job Corps Sample (Experimental and Control): 120 
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API 

Purpose : To ascertain if a programmed and systematized total package, 
including basic language and computational skills, will produce better 
educational results than a less unitized program such as the one now 
in use in Job Corps. 

i 

Site: Guthrie (630) 

Design; One API cell and one traditional Job Corps cell per site. 

Methodol ogy: Upon entering Job Corps, students will be pretested 
using the RJSl and MJSl according to the center's normal orientation 
procedures. Based on the results of these tests,. gross differen- 
tiation of students into beginning, graded and GEO levels in reading 
and math will be made. Within each group, students will be matched 
and then randomly placed into either API or the regular Job Corps 
program. This leveling procedure willonsure that people at all levels 
are equally represented in both experimental and control groups. Al- 
though it would be ideal to have a student placed in API use only the 
API materials, this may not be feasible from a center scheduling 
perspective. Therefore, the one large API cell will be broken down 
into reading, math, and GED components. 

Stjdents who fall in the beginning and graded levels of the program 
will be pretested using the Reading Comprehesion and/or Mathematics 
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Computation subtests of the Stanford Achievement 'Test, Form ^. Those 
placed into API will take all necessary placemGnt tests prescribed 



by that program. 



Students will then spend 90 instructional hours in 
their respective Curricula. At the end of 90 instructional hours in 
conterjt area (reading,, math) students will be posttested using the 

alternate form of the above-mentioned SAT instruments • In addition, 

I , 

those involved with API will complete process evaluation questionnaires 

Insofar as the 6ED level is concerned, students entering the GEO pro- 
gram according to the regular J^pb Corps procedures will be randomly 

placed into API or the Job Corps program- All students will then be 

; I 

pretested using the Official GEO Practice Test, Form A. Students 
will then follow their respective curricula for 90 instructional 
hours. At the end of this time, students will be posttested using 
the alternate form of the above-mentioned instrument. In addition, 
those involved with API will! complete process evaluation questionnaires 

Hypotheses: That a total program will prove more effective than a 
fragmented one over the long run, even if educational gains data do 
not illustrate a significant difference between programs. It is be- 
lieved that the total program approach will enable students to pro- 
gress through the various curricula at a more rapid pace, thereby 
lessening the overall time which they must spend in Job Corps in 



order to- attain their personal goals. 

i 
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Analysis: Reading and math gains will be analyzed as previously dis- 
cussed for other programs; analysis of GED will be as delineated for 
other GED programs. 

Sample; 



Guthrie 


Reading 


Math 


■ GED 


120 


120 


.30 



\Experimental Sample Size: 270 

\ ■ • 

Total Job Corps Sample (Experimental and Control): 420 (Same control 
group used for both API reading and math programs.) 
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Purpose; To ascertain if a programried and systematized total .package— 
concentrating on essential adult coping skills and indirectly providing 
langauge and computatione"" skills instruction leading to a recognized 
competency-based high schdol diplonia^or eqtf'ivalent— will produce better 
educational results than wil.l be less unitized instructional system such 
as the one now. in place within the dob Corps. 



Site; EL Paso (400) 



1 • ' X / 

Design; One APL cell and one traditional Job Corps cell per site. 

o 

^ a 

Methodology: Upon entering Job Corps, students will be pretested 
-using/ the RJSl according to the center's normal orientation procedure. 
Based on the results of this test, students will be grouped into 
beginning, .graded, and GED groups. Within each group, students will 
be matched and then randomly placed into either APL or ihe regular . 

* 'c 

Job Corps program. This leveling will insure that people at all 

• ' ' \ ( 

levels are represented equally in both experiemntal and control 

groups. Once a student is placed into APL, the individual will take 

all components of the ALP program, thus eliminating contamination of 

the design caused by crossover between programs. 



students who fall into the Jieginnng and graded reading levels of the 
program will be pretested using the Reading Comprehension and 
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Mathematics Computation subtests of the Stanford Achievement Test, 
Form A. In addition,' they will be pretested using the ACT'tests, 
.according to program description. Students will then spend 90 in- 
structional hours in their respective subject matter curricula. 
At the end of 90 hours, students will be posttested using the al- 
ternate forms of the above-mentioned SAT instruments. In addition, 
all those involved with APL will complete process evaluation ques- 



tionnaires. , .. 

Insofar a s the GEO level is conceme d.^students-enter-ing-t.hP-RFn'prn- 
gram according to regular Job Corps procedures will be randomly placed 
into- APL and the Job Corps programs. All students will then be pretested 
using, the Official GEO Practice Test, Form A. These students will also 
take the ACT test. Students will then follow their respective curricula 
for 90 instructional hours. At the end of the 90 hours they will be 
posttested using the alternate form of the Official GEO Practice Test. 
In addition, !hose involved with APL will complete process evaluation 
questionnaires. 



Hypotheses; It is believed that a total program will prove more 
effective than a fragmented program over the long run even if edu- 
cational gains data "does not illustrate a significant difference be- 
tween programs. It is also believed that the opportunity to obtain 
a high school diploma will be considered to be extremely important 
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to Job Corps enrollees. Additionallly, it is believed that a total 
program will enable students to progress "at a much more rapid rate 
because of coherence of programmatic materials. It is felt that 
considerations* such as these need to outweigh educational gains 
data for this particular program. 

Analysis; Reading and mathematics gains will be analyzed as pre- 
viously discussed; analysis of GED will be as delineated for other 
GED programs. Analysis of ACT test results will be a 2 sample t tests. 



Sample: 



El Paso 



40 



Experimental Sample Size: 40 



Total Job Corps Samp^le (Experimental and ControH< 80 




\ 




BILINGUAL/ENGLISH AS A SECOND LANGUAGE 

/ 

Purpose: To ascertain the efficacy of providing Spanish speaking/ 
reading Corpsmembers with little or no English language competency • 
with either translated Job Corps materia*j^s]and training in English 
as a Second Language or wich just training' in English as a second 
language. 

Sites: 'Clearfield (1250) 
El Paso T400) 
Gary (2200) 
Phoenix (415) 

San Diego (600) - alternate site 

Design: One bilingual/ESL and one ESL cell per;' site. 

/ 

/ 

All incoming enrollees will be tested-on the pJSl according to normal 
center orientation procedures. Those scoring 8 or below on the RJSl 
will be further orally* screened to determine if they are Spanish 
speaking according to procedures already in^ use at the sites in- 
volved. A pool of entrants will be formed from this group and they 
will be randomly assigned to either ESL-Defense Language Institute 
(DLI), ESL Job Corps, or ESL-Bil ingual . - They will then proceed 
according to the 'component specific methodology delineated below.- 
It should be noted that, in addition to program specific requisite 
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tests, 311 enrol lees in both the bilingual and the ESI. components 
will be pretested and posttested on a standardized measure, i.e. 
the Peabody Picture Vocabulary Test on entry to the ESL portion of 
their training and on exit from that phase. In addition to the 
above test, all subjects will take Form A of the Reading Comprehen- 
sion section of the Stanford Achievement Test (SAT) as a pretest on 
entry into the regular Job Corps educational program. All subjects 
also will be, posttested after 90 hours in that program on Form B of 
the SAT. These tests will yield a short term measure of the in- 
crease in skills as measured by the Peabody as well as long term 
educational grade level gain as measured by the SAT.. 

A. ESL-Bilingur.l (ESL-BI) 

This, approach utilizes a bi lingual instructor and Spanish trans-, 
lated materials while the Corpsmeniber is learning English with a 
gradual transition to no spoken Spanish and all written English 
materials. 

Entering Corpsmembers will be placed in the program, be tested on 
the Peabody, and learn English by this combined method. The ESL 
component will be the DLI or alternate ESL program. Students will 
remain in this program for a minimum cf 6 weeks, at which time the 
American Language Course Placement Test (ALCPT) will be administered. 
A minimum score of 40 on the ALCPT will be needed to proceed out of 
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ESL-BI into the Job Corps English Reading Program* The student scoring 
below 40 remain:^ in ESL-BI until he attains that standard as measured 
by alternate forms of the ALCPT, A process questionnaire designed 
to measure satisfaction with the ESL-BI portion of the program and 
a pretest on the Peabody will be given on exit from this phase. When 
the Corpsmember qualifies for exit as determined by performance on 
the ALCPT, the JRCPl is administered. 

If|the Corpsmember scores above 11 on the JCRPl, he/she is placed 
— ifLLthe-aiipro p ria t e-level-of the graded reading program. If the 
score is below 11, placement is in Level A of beginning reading. 
These individuals will continue supplemental ESL-BI instruction on • 
an as needed basis to be individually determined by the ESL instructor. 

Approximately one month* after the Corpsmember has entered the regular 
Job Corps program, the Reading Comprehension Subtest r f the Stanford 
Achievement Test (SAT) will be administered. Form A will be used for 
this testing, administering Primary Level II to thosej in beginning 
reading and Intermediate Level I to those who have placed into graded 
reading. After completion of 90 hours in the reading program, a SAT 

! 

posttest will be administered. The level of this, ar'id subsequent 

'^jsosttests , will be determined based on individual performance as 

i " I 

for the rest of the EIE study. After 150 hours in the Job Corps 

reading program, a second SAT posttest will be administered. 
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B. ESL Program - DLI 

The ESL program to be used is the Defense Language Institute (DLI) 
' audiolingual program. Two levels of DLI, the pre-elementary and the 
elementary, will be used. No translated material is provided and the 
enrollee is completely enmeshed in the new language, English. Placs- 
■ ment into DLI is random from the same enrollee pool as used for place- 
ment in the bil ingual/ESL program. 

Entering Corpsmembers will be tested using the Peahody and will be 
given the DLI placement test, and will be placed in either the 
pre-elementary or the elementary levels of DLI. The DLI placement 
test is the American Language Course Placement Test (ALCPT). The 
test is composed of 100 questions are an oral test in which the 
student listens to a test tape. The remaining 40 questions test ' ' 
reading comprehension. The test score reveals the English Compre- 
hension Level (EfL) and accurately pldces the student in either the 
pre-elementary or elementary phase of the DLI program. All answers 
to the test are recorded by the student on the ALCPT answer sheet. 
They will proceed in the ESL program for 3 hours per day with an 
additional hour of supplementation using the Sullivan beginning 
reading materials for a minimum of 6 weeks. At that time, an alter- 
nate form of the ALCPT will be administered. A minimum score of 40 
on the ALCPT will be needed to proceed out of ESL into the regular 
Job Corps reading program. The student scording below 40 remains 
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in ESL until he can attain tha\: standard as measured by an alternate 
form of the ALCPT. 



Corpsmembers then follow the same procedures as del 
ESL-BI phase. 



ineated for the 



It should be noted that the prescribed methodology 
accounts for only 4 periods per day. It is suggesl^ed 
be placed in mathematics classes for one period per 
may be used for additional supplemental reading ins 
components of the Job Corps program at the discreti 



described above* 

chat Corpsmembers 
day. The remainder 
truction or other 
3n of the centers. 



Centers will be asked for scheduling information so that it may be 
taken into account in the determination of results.' Additionally, 
centers will be asked to be consistent in Corpsmember scheduling 
within each level of ESL. 



/ 
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CAI - COMPUTER ASSISTED INSTRUCTION 

Purfiose: To ascertain whether educational gains are significantly 
different for students who use a computer-assisted and/or managed 
instructional approach to learning rather than a noncomputerized 
traditional paper and pencil approach. 

Two computer-assisted instruction (CAI) learning systems are included 
in this model. The first of these is PLATO and the second employs 
a BTI 5000 mainframe computer. Both systems include reading, math- 
ematics, (above grade 3.0), and GEO programs. 

-S^'tes: Clearfield (1250) - PLATO 
Phoenix (415) - BTI 

Desian: One graded reading, one graded mathematics and one GEO 
experimental cell; one graded reading, one graded mathematics and one 
GEO regular Job Corps cell per site. 

Methodoloazi All incoming Corpsmembers will be tested using the RJSi 
and MJSl and/or MJS2 according to normal orientation procedures. Those 
students who score at a level of 3.0 or above on these tests will be 
considered for inclusion in the experimental program. Both centers 
involved in this model have the new reading program and, in addition, 
Clearfield also has the staffing model. Insofar as thi graded reading 
program is concerned, randomization of subjects into groups will take 
all relevant models into account (4-way at Clearfield and 3-w^ at 
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' Phoanix). Insofar as mathematics is concerned, students will be 

placed in either traditional Job Corps or CAI curricula. No 
j restriction 'of all or none scheduling regarding the CAI curriculum 
; is being made because of center scheduling problems. 

r 

All st^udents in this part of the model are pretested using the 
Reading Comprehemsion and/or Mathematics Computation subtests of ' 
the Sta\^ford Achievement Test, Form A. They then follow the curric- 
ulum delineation of the program, in which they are placed. At the 
end of 90 instructional hours in reading and 90 instructional hours 



in matheniatics^ all studfepts will be posttested using "tTe Reading 




\ 



Comprehension and Matnematics Computation subtests of the SAT, 
Form F. 

For the GEO portion of the modeiC^Corpsmembers eligible -for and en 
tering the GEO program according to normal* Job Corps criteria, 
wi>l be randomly placed in experimental and control groups .^^Stjiden^^ 
will then be pretested using the Official -GED^'^ra<HHt:e^1^t, Form A. 
Students will then follow the curriculum of the program in which'they 
have been placed for 90 instructional hours. At the end of this time, 
Corpsmembers will be posttested using the Official GEO Practice Test, 
Form B»- This procedure will enable the assessment of educational gain. 
In addition, for those taking tils GEO test, data will be maintained on 
GEO test scores, pass/fail rates, and time-in-program required to com- 
plete the GEO. All Corpsmembers, teachers, and Basic Education Directors 
involved with CAI will complete process evaluation questionnaires and 
those in the control group will complete brief attitude questionnaires. 
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Hypotheses; In the first cohort, there will not be a significant 
difference between CAI and non-CAI programs. This can be accounted 
for by newness of working with a computer and its system, etc. How- 
ever, in the second cohort, there win be a significant gain difference. 
It is also believed that a decision between PLATO, and BTI will have 
to be made on criteria other than gains - both should result in 
approximately equal gain, and a decision may. have to be bisfid on such 
things as CMI capabilities, cost, range of available programs, etc. 

t 

■ ^"^^)^sis: Analysis for the graded program will be the same as that' 
del'ineated for the new readilTg" program" 'and CAI Math'models. GEO ' 
analysis will be the same as specified for the Cambridge GEO program. 



Sample: 



Clearfield 


Phoenix 




96 


75 



Experimental Sample Size: 171 

Total Job Corps Sample (Experimental and Control): 342 



87 



lOG 



CAI MATH 

Purpose ; To assess the systematic use of the Monroe Classmate 88 as .a 
supplemental learning aid in the regular Job Corps mathematics program. 

Sites : Guthrie (630) 
Woodstock (430); 

Design : One experimental and one control cell per site. 



Methodology : Incoming Corpsmembers will be 'tested usir.g the MJSl 
and/or MJS2 according to normal center orientation procedures • Based 
on these scores, gross math levels will be determined. Within each 
level, students will then be randomly placed into treatment and control 
groups. All students will then be pretested using the Mathematics 
Computation Subtest of the .Stanford Achievement Test, Form A. Students 
in the experimental cell will then take the regular program with the 
addition of^'^specified amount of drill and practice, at applicable 
levels, using the., Classmate 88. At the end of 90 instructional hours, 
all students will \^e posttested using the Mathematics Computation 
Subtest of the SAT,; Form B. In addition, teachers and Corpsmembers 
involved in the use of the Classmate 88 will complete process 
evaluation questionnaires to assess satisfaction with the program. 

Hypotheses : There will be a significant difference in gain between 
treatment and control groups. However, process evaluation may show 
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that teachers would prefer a supplemental aid that would alley input 
Of specialized problems for several students. 

Analj^sis: 2 sample t test on gain scores; where possib,le, ANGOVA 
within levels for intra-center analysis. The inter-c^nter analysis 
/ will involve the use of the 2 sample t test to determine -If there is 
a significant difference in gain between the two centers. 

Since this program is already in place in both sites, albeit not-well 
defined or'prescribed, it is not believed that a second cohort-wi-M-- 
•be .necessary in order to make a determination about the advisability 
of Job Corps wide implementation. 

Sample: 



Guthrie 


Woodstock 


100 


50 



Experimental Sample Size: 50 

Tota^ Job Corps Sample Size (Experimental and Control): 300 
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CAMBRIDGE GED 




Purpose ; - To ascertain iff a GED program employing a multi -media 
approach to teaching GED skills achieves a significant difference 
-itt-the-per-fopance of students on the GED test and/or on the rate 
of acquisition of, the GED. 



Sites : Breckinridge (2600) 
• Tongue Point ' (480) 

Design : One Cambridge GED and one regular Job Corps GED cell per 
site. 

Methodology : Corpsmembers eligible for and entering the GED program 
according to normal Job Corps procedures will be randomly placed in 
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treatment (Cambridge) and control (Job Cprps GED) groups. All students 
will then be pretested usjng the official\GED Practice Test, Form A. 
Students will then follow the curriculum d^signa'ted by each program. 
Requirements may be modified depending on tne specific needs of each 



student as evidenced by performance on the pr^etest. Thus, the Practice 
GED test will serve not only to familiarize C^psmembers with the form 
and substance of a GED testi) but will also pro>)^*de evidence as to the 
pattern of strengths and weaknesses of each Cor^member. This infor- 
mation should aid in reducing the time each student needs to spend in 
GED by providing training only in those areas wherey^t is needed. At 
the end of 90 instructional hours, all students will\be posttested 
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using the Official GED Practice Test, Form. B. However, even more 
crucial to this program is the assessment of GED acquisitions, There- 
fore, scores which students taking. the 6ED test obtain will be tracked; 
the pass/fail rate on the GED test will be tracked; and the amount of 
time which a student needed in program before the successl'ul completion 
of the GED test will be recorded. Thus, assessment of the adequacy 
of the program will be based on a combination of educational data, GED 
- test scores, and the rate of GED acquisition. 

Hypotheses: It is believed that the results from the first cohort will 
show no significant differences between the two programs. However, it 
is felt that use of a second, cohort will demonstrate a significant 
difference in favor of the Cambridge program. Literature appears to 
demonstrate that a multi-media approach to instruction is more effective 
than a paper and pencil method. It is felt that this will not be 
evidenced during the first cohort because modifications in the structure 
of the Cambridge program for the Job Corps population (adding drill and 
practice and lecture in some areas, for example) may be necessary in 
order to have the program function more effectively. These modifications 
could be based on the process evaluation questionnaires completed by 
teachers and Corpsmembers in the first cohort. With these changes in 
place, the performance of the second cohort in this program should be 
significantly better. 

Analysis: A 2 sample t test on the gains while in the program, will be 
the basis of both the intra- and inter-center evaluations. This will 
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be used between the two GED programs within each center and for the 
Cambridge GED across the two centers • If there is a significant 
d'iffettence 1n the gains in the two centers, demographic characteristics 
of the respective population will be studied as well as possible within 
center modifications to the program in an attempt to delineate causation. 
Additionally, within each center, study will be made of the pass/fail 
rates on the GED test and time-in -program in order to determine, if 
these are significantly different between the two programs in use at 
each center. 

Sample : 



Breckinridge 


Tongue Point 


■ 60 


50 



Experimental Sample Size: 110 

Total Job Corps Sample (Experimental and Control): 220 




CMI ADAPTED MODEL 



Purpose : To ascertain if a computer-managed instruction approach to 
diagnostic and gains testing, instructional prescription ^and student 
progress data will positively affect teacher/student interaction time 
and student progress -through an educational program. ^ 



Site : Gary (2200) 

Design : Three CMI cells and three non-computerized traditional Job 
Corps cells per site. 

Methodology : Incoming Corpsmembers will be randomly assigned to CMI 
and non-CMI cells. Those in the CMI cells will then follow the CMI 
program description for all .relevant parts of the Job Corps program. 
Those who are not involved in Cf4I will be pretested using the Reading 
Comprehension and/or Mathematics Computation subtests of the Stanford 
Achievement Test, Form A cr the Official GED Practice Test, Form A. 
After *90 hours in the appropriate curriculum, students will be post- 
tested using the alterniative form of the above-mentioned instruments. 

^ X 
/ •* 

Hypotheses : That a CMI systems approach will cause an increase in 
educational gains of those students involved in CMI vis-a-vis the 
lon-CMI paper and pencil control groups. These effects will be based 
on several factors: increased Corpsmember motivation* usually 
associated with CMI-type educational programs; more individualized 

instruction prescription; and more time for teachers to teach. 

\ 
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Analysis ; In addition to the analysis of educational gains, as 
delineated for other programs, several other factors will be con- 
sidered. A comparison of the amount of teaching time directly spent 
with students will be ma'de. This will.be based on observational data 
collected by trained observers. Student motivation will be compared 
utilizing questionnaires administered to a sample of CMI and non-CMI 
students. In addition, analysis of the effect of lessening the 
amount of paper and pencil recordkeeping on the operation of the 
center as a whole will be made. This latter analysis will be based 
on discussions with center administrative personnel and teachers.' 

o 

Sample : 



Gary 


Reading 


Math 


GED 


lOd 


100 


100 



Experimental Sample Size: 300 

Total Job Corps Sample, (Experimental and Control): 500 (Same control 
group used for CMI reading and mathematics program.) 
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LEARNING DISABILITIES 



Purpose ; To assess the functioning of different programs for diag- 
nosing learning disabilities and for teaching remediation and/or 
compensatory skills to those Corpsmembers who have a treatable learning 
disability which may hinder their performance in Job Corps. 

Sites: Breckinridge (2600) 
Gainsville (350) 

Design : Four cells per site. 

Methodology : Because, of the nature of the Learning Strategies program, 
they will be treated differently from the other EIE models. Corps- 
members entering the centers will be given the RJSl and MJSl according 
to normal center orientation procedures. The belief of the researchers 
is that students with moderate to severe difficulties in learning 
will score 8 or below on the RJSl. Therefor'e, all Corpsmembers who 
fall into this category will be given the Stanford Achievement Test, 
Primary II, Reading ComprehenSjion Subtest, Form A. We know from 
extensive EIE experience that this form of SAT test- can successfully 
be given to this sample. ^ Students will then be placed in regular 
Job Corps program. During the first six weeks in class, teachers 
trained in the program identification techniques will identify Corps- 
members in need of further screening as specified by each of the two 
programs. Those who do have a specific learning problem (or problems) 
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will be matched based on the disability and will be randomly selected 
as either experimental (new strategies) or control (regular Job Corps 
program) in the ratio of 2:1 within their existing placement. Addi- 
tionally, Corpsmembers who score at the same entry test level but 
who are not identified as having a specific learning problem will be 
randomly placed into experimental and control groups. The result is 
a 4 cell design involving ranoomization at two levels (those identified 
and those not identified). Students will be in the same classes with 
the difference involving the materials -which are used. They will be 
given the tests which are desjgnated by the' particular program involved. 
J\t'^tfie end of 90 in-program hours, students will be posttested using * 
the SAT Primary II, Reading Comprehension Subtest, Form B. They will 
also be given a process evaluation questionnaire. At this time, teacherjs 
and Basic Education Directors will also be given process evaluation 
questionnaires. 

It should be noted th2(t\these programs are developmental in nature 
and are using strategies developed for non-Job Corp populations. 
Second cohort modifications will be made based on Job Corps experience. 
The program developers will turn, reports in to the evaluators every 
three months. /The content of these.. in addition to data maintained 
by the reseaij^chers, will form the basis of program modifications. 

Hypotheses and Analysis ; It is the belief of the researchers that the 

Strategies used in these programs will benefit all Job ^o^PS enrollees. 

'\ 

Even those individuals who are not identified as learning disabled may 
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well possess skill deficits because the typical Job Corps enrollee is 
reading on a fifth grade Iveel and has not obtained a high school 
diploma. The four cell design specified herein will enable the as^ 
sessment of program impact on both identified and non-identified 
Job Corps enrollees. However, it should be noted that the n In each 
cell for each cohort is small enough where statistical significance 
may not be reached. Combining samples across .cohorts, however, should 
provide a sufficient n for analytical purposes. Additional assessment 
of program impact will be made through use of process evaluation ques- 
tionnaires designed to measure program impact. 

The analysis for these programs will also consider other factors. 
Length of stay in program will be tracked to determine if the skills 
deficit remediation approaches contained in these two programs have 
an effect on enrollee retention. In addition, multiple regression 
techniques will be used in an attempt to isolate predictors of learning 
disabilities and to develop an equation to predict the existence of 
this type of problem. Data being collected in the rest of the EIE' 
study is attanpting to profile the early Job Corps terminee. The 
results of this latter analysis will be compared with the former in 
an attempt to determine similarities or lack of same. If, in fact, 
the two regression equations are similar, the early terminee may be 
leaving the program because of undiagnosed and/or untreated learning 
problems. This analysis should aid in the determination of whether 
skills deficit remediation programs need to be made widely available 
in Job Corps • 
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Additional use can be jnade of the existing EIE data base by matching 
on demographic and entry test characteristics those students who do 
not have available specific skills deficit programs. In this weo', a 
more widespread determination can be made as to whether or not the 
skills deficit prog'ram has an impact on educational gain, retention 
of Corpsmembers , and/or program satisfaction. 
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NEW READING PROaRAM-(NRP) 



Purpose ; To test the effectiveness of the New Reading Program (NRP) 
as related to the Old Reading Program (ORP), in terms of both accuracy 
of th? placement procedure and the educational oains which the Corps- 
members attain in the progra'^ 

Sites ; Breckinridge (2600) | 
Clearfield (1250) 
Gary (2200) 
Phoenix (415) 
Tongue Point (480) 

Design ; One experimental (NRP) and one control (ORP) cell per site. 
However, within each of these cells, students will be brokan down inlio 
beginning and graded reading based on RJSl scores. This breakdown into 
levels will enable the assessment of both the educational gains for 
the program as a whole and a level by program' interaction. 

Methodology : Incoming Corpsmembers will \ be tested by the use of t\\e 
RJSl according to the center's normal ori^^entation program procedures. " 
Based on performance on this test, a gros^ placement differentiation 
insofar /as^^ginning or garded reading placement is concerned will be 



\ 

made. Within each level (beginning or graded) students will be placed! 
in-eithir_the new readi ng- program _or the ojld reading program., Jhij \ 
assignment of Corpsmembers to programs wiljl be made on a random basis. 
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(At Breckinridge and Clearfield which have the staffing model- begin- 
ning and graded reading placement randomization will also have to take 
this program into account. In addition, Clearfield has a CAI graded 
reading program, so graded reading randomization would have to be 
four-way.) This within-level randomization procedure will insure 
approximately equal sample sizes within a given level for analytical 
purposes; additioiially, it should enable all programs to be represented 
in an equal manner at each site. 

Corpsmembers involved would then be pretested using the Reading Com- 
prehension Subtest of the Stanford Achievement Test, Form A. Assign- 
ment of students into appropriate levels of the SAT would be related 
to performances on thd RJSl. Corpsmembers in the New Reading Program 
or the New Reading Program with aides, would then be tested using fue 
JCRPl for actual placement into the reading program. The programs 
would then be implemented according to their respective manuals or 
curriculum guides. At the end of 90 instructional hours, all students 
would be posttested using the Reading Comprehension Subtest of the 
SAT, Form B. At the same time as the posttest, Corpsmembers and teachers 
involved with the new reading program would also '-.omplete process, 
evaluation questionnaires dealing with program satisfaction and the 
need for programmatic or implementation modifications. 

Hypotheses : Because there is very little systematic difference between 
the new and the old Job, Corps reading programs, there will probably 
not be a significant difference in educational gain. However, there 
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are several ramifications other than educational gain which need to 
be taken into consideration. In the first place, it is possible that 
the gain in the new reading program may be less than that in the old 
program. In the first cohort, this could be due to lack of familiar- 
ity with the. program materials and the placement procedure. However, 
the new program also contains much more content within each level, 
and students will probably not progress through levels as quickly as 
they have previously. This could account for less gain. However, it 
is believed that this increase in content and the addition of more 
relevant content will have a signigicant effect on the retention of 
learning and the mot-.vaticn of Corpsmembers. Therefore, it is planned 
that a follow-up testing of the remaining sample will be done at 150 
instructional hours using the SAT, Form A. Because of the time-lapse 
of approximately seven months, the repeat of the same form should not 
statistically influence the comparison. 

Analysis; Analysis of covariance (ANCOVA), using the pretest scores 
as the covariate, is probably the most ideal procedure for the analysis 
of educational gains. However, it is believed that, for the total 
program, there will be a violation of the basic assumptions of ANCOVA 
(the homogeneity of regression assumption will most likely be violated.) 
If this'does, in fact, occur, 2 sample t test on the gain scores will 
be used to determine if there is a significant difference. Additionally, 
the Analysis of Variance (ANOVA), using a randomized blocks design, 
would enable the determination of the program by level interaction 
(does one program work better for beginning reading students and another 
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for graded reading students, etc.) The foregoing will be the main 
thrust of the intra-center evaluation of the new reading program as 
, tompared to the old. 

In addition, comparison across centers can be done using an ANOVA 
modfcl on the gain scores for the new reading program in order to 
determine if there is a significant difference across centers. If 
the ANOVA is significant, a multiple comparison procedure could be 
employed to ascertain where the difference lies. One could then look 
at the characteristics of the student population for the center to 
attempt to determine what f actor (s) may have accounted for the 
differences. 

Sample: 



Level 


Center 


Breckinridqa 


Clearfield 


Gary 


Phoenix 


Tongue Point 


Beginninq 


75 


80 


80 


20 


33 


G 


raded 


100 


160 


160 


50 


67 


li 


otal 


175 


240 


240 


70 


100 



/ 



Experimental Sample Size: 825 

Total Job Corps Sample (Experimental and Contfblj: 1650 
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STAFFING MODEL 



Purfiose: To test the effect of the use of trained peer aides in the 
classroom for the new reading program. Peer aides will be used in 
boith' the beginning and graded reading classes. 

Sites ; Breckinridge (2600) 
Clearfield {1250) 

Design; Two new reading program cells (one beginning and one graded) 
and two new reading program with aides cells (one beginning and one 
graded) persite. 

Methodology; Peer aides at or near graduation will be selected at both 
Breckinridge and Clearfield. They will be given a joint training pro.- 
gram at Clearfield which will be approximately two weeks long and will 
include both human relations training and reading program training. 
Incoming Corpsmembers will then be pretested using ths RJSI according 
to the center's normal orientation procedure. The methodology is then 
the same as that for the new reading program design with the exception 
of the use of peer aides in the beginning and graded classes'; In each 
center, each of two teachers will be assigned a teafn of four trained 
Corpsmembers who will be designated as psid peer aides. The teachers 
will operate with the aides for one half of the day and without the 
aides for the^other half of the day. The i-ame Corpsmember group will 
perve both teachers during tho day and will work with both beginning 
and graded reading students, 
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Hypotheses t It is fjypothesized that the use of peer aides should en- 
"eible the teachers to have more interactive teaching time to spend with 
Corpsmembers . It is also hypothesized that, particularly in the be- 
ginning reading classes, the aides will have a significant impact. In 
addition to assuming^lnany of the non-teaching functions such as data 
.collection and recordkeeping, aides should.be able to give at least 
some of the individualized attention and drill which is needed at the 
lower reading levels. Further,, it is felt that a second cohort would 
be beneficial in this model because it would .enable the assessment of 

increased effectiveness of peer aides with increased familiarity with 

i 

program materials and recordkeeping functions. Additionally, aide ef- 
fectiveness should increase-as the new reading program is .furtfier re- 
fined. 



Analysis ; The inter-center analysis precedure for this model is the 
same .as that for the new reading program. Additionally, within each 
level of the program, a 2 sample t test. will be used to determine if 
there is a significant difference between the new readijig program- with 
and without aide^. Also, since the Clearfield center is now uling 
aides in the old reading program, a 2 sample t test will be used to 
determine if tFefe is a significant difference between the new 'anc( old 
programs. The inter-center analysis w^ be a 2 sample t test on the 
educational gains in the staffing model cells, only between Breckinridgt 
and Clearfield to determine if there is a significant difference in 
the functioning of the model between the two sites. This analysis can 
be performed both on the total program and also within each level of 
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reading. If a significant difference is fbund, demographic ' 
characteristics of the sample population and center program specifics 
will be psed in an attempt to account for the differences. " ' 

In addition, a procedure to have monitors observe and /record the 
number and length of one-to-one teacher/Corpsmember interactions 
will be developed. This aspect of the analysis will test whether 
the use of peer aides is enabling the teachers to spend a significantly 
increased amount of time with Corpsmembers. 

In addition to the analyses which will be performed on data from the 
Corpsmembers and teachers involved 'with the staffing model, it is 
desired to determine what, if any', effect there is on the Corpsmembers 
who act as aides. This model wilf involve both existing Corpsmembers 
and graduates of Job Corps as, program aides. This fact will enable 
the determination of several interesting side effect\ to the 
educational gains of the Corpsmembers who are being tutored by the aides 

In the first place, by administering reading comprehension pretests 
and posttests to the aides, it will be possible to determine if the 
Interaction which the aides will have with the Corpsmembers has any 
effect on the reading ability of the aides. Therefore, educational 
gains in reading will be measured for the aides. In addition, because 
aides will be both Corpsmembers and graduates, it will be possible 
to determine whether there is a differential reading gain rate for these 
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groups. Because the number of^aides involved is so small, virtually 
nothing could obtain a level of statistical significance. Also, it 
is not wise to base a definitive determination on so small a sample. 
However, this additional data should help in a determination of the 
•viability of an aide program for reading within Job Corps as a whole. 
All of the aboye^nformat'iorr,Trraddi^ion to the type of information 
which is being gathered and anaiyzed relating to all of the models, 
will enable the Department of Labor to make a more informed decision 
regarding using aides within Job Corps on a more extensive basis than 
thc^y are currently being used. 



Sample: 



Level 


Breckinri dge 


Clearfield 


Beginning 


75 


80 


Graded 


100 


160 


Total 


175 


240 



Experimental Sample Size: 415 

Total Job Corps Sample (Experimental and 8ontrol): 930 
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CHAPTER 5. THE EXPERIMENTAL DESIGN AND INSTRUMENTATION MECHANISMS 

The Educational Improvement Effort (EIE) was designed to follow a 
random assignment/experimental design controlling for major factors. 
Despite extensive controls achievable in the Job Corps setting, 
researchers do not have control over all extraneous intervening 
variables. However, there is" an effort in the design and its 
implementation to tontrol variables as much as possible, and to 
provide adequate data for statistical adjustments where the method 
breaks down. The experiments in each center have been established 
with detailed, reporting and assignment procedures. In the imple- 
mentation of models, efforts were made to assurejthat these were not 
simply assigned to the best teachers. Under the contract, outside 
monitors regularly review EIS implementation and supervise the 
random assignments of youth into the models. With a data system 
which records daily input and transfer of enrol lees within the 
system, it is possible to quickly spot and correct for variances 
in the random assignment procedures. 'In all of the models and 
their controls, the same general procedures are followed, as noted 
in the previous descriptions of the designs for identified models. 

Entering Corpsmembers are tested on the RJSl and MSJl according to 
the normal orientation procedures of the centers. Based on the" 
results of these tests, eligibility for experimental programs is 
determined (some programs have entry level reading and/or mathematics 
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capabilityTequirements). Once eligibility has been determined, the 
Corpsmembers are randomly assigned to groups. After the Corpsmembers 
are placed into an education program, they are pretested using either 
the Reading Comprehension and/or the Mathematics Computation subtests 
of the Stanford Achievement Test (SAT) for programs at the beginning 
or graded levels, or on the Official GED Practice Test for programs 
at the GED level. Appropriate levels of SAT testings are determined 
from grade level translati^jns^ from the RJSl and/or MJSl. The SAT 
was chosen as the measure of gain\ecause it had been extensively 
used in Job Corps before, it is withtn the educational capability 
-scope of most Job Corps enrollees, and the centers were familiar 
with its use. In addition, the normative and technical data on this 
test is extensive and it had been normed, at least to some extent, on 
a group similar in characteristics to the* Job Corps population. The 
test had alternate forms and was available at enough different 
levels of educational 'capability to cover the full scope of the 
Job Corps population: (See Chart 5) 

The original design called for posttesting after 90 in-subject 
content hours and for the, posttesting of all terminating Corpsmembers 
who had participated for more than 30 content hours. However, 
obtaining this latter posttest presented numerous problems. Most 
of the Corpsmembers terminating from Job Corps do so in such a manner, 
i.e., AWOL or sudden exit, that the on-site monitor does not get 
enough advance notice to schedule a posttesting session. There have 
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also been numerous occasions when the existing Corpsmember has flatly' 
refused to take a posttest. Forcing the issue would result in invalid 
data. < 

Therefore, as the study has progressed, certain modifications had to 
be made "to the research design because of the non-laboratory setting 
of the experiment. Students who are suspected of termination will be 
posttested at 50 in-program content hours in order tr supplement the 
data based. Students who remain in the; program will be posttested at 
90 in-program content hours and again at 150 hours. Additionally, 
there will be a one year posttest for all EIE enrol lees who are still 
in Job Corps in order to assess the learning, curve and retention of 
learning in experimental vs. control program enrollees. Ip order 
to increase Corpsmembers willihgness to take the requisite posttests, 
an incentive payment of $5.00 or $10.00 will be made for various 
posttests. 

I 

i. 

Additionally, as preliminary data viej'e analyzed, it became evident 
that some Corpsmembers were ceiling [out the SATs. The original 
plan called for the use of the samejlevel of test, alternate form, 
at the 90 hour posttest. This has be6n modified to take the ceiling 
effect into consideration. Subsequent levels of the SAT are determined 
on an individual basis dependent on results of the previous SAT. 
There is sufficient overlap In the SAT to enable moving four levels 
without contaminating the data metric, so this new procedure should 
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not be a problem statistically. 

The EIE Data Collection System has been designed to. capture relevant 
data on all Corpsmembers involved in the study. A description of 
the hardware may be found in the Educational Improvement Effort. 
Evaluation Design (TEAM Associates, Inc. 1979.) and details of the 
procedures may be fdund in the Data Collection Guide for EduraHnnai 
Improvement Effort Project (Texas Educational Foundation, 1979). The 
system operates by data transmission by means .of optical scanner via 
phone line to a central computer. The data is then edited, reports are 
sent to the site for corrections, and the corrections are then trans- 
mitted. Once the data is correct, it is transferred to a permanent . 
file where Corpsmember data remains as long as the individual is an 
active participant in the study. Once the Corpsmember is terminated 
from the study, the data is transferred to a termination file where it 
is peif^nently stored. 

The data collectioh system contains jin formation on active and inactive 
Corpsmembers in the EIE, at all Job Corps centers involved in the 
study. In addition, the system contains message capability allowing 
rapid communication from site to site and enabling the evaluators 
to -communicate with individual sites or with sites simultaneously. 
Data is compiled for review in two forms-weekly summaries for each 
site, and year to date summaries containing cumulative information 
for each site on a program by program basis. These reports allow 
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the eyaluators to be continually aware of the status of each program/ 
and enable almost immediate discerning of difficulty relating to 
the EIE communications network. 

Considering the complexity of the data collection network, relative 
few difficulties have been encountered. Errors relating to the 
data collection program are corrected by TEF (Texas Educational 
Foundation) with program modifications being made as the nee^l arises. 
Thus, in some sense,' the network is still in the formative stages. 
Hardware breakdown has caused some delays in data transmission at 
several sites. These protilems have become increasingly more frequent 
as the study has progressed. Equipment suppliers are attempting 

to determine the causes o!f the problems to alleviate the difficulties. 

! 

The closer the maximum level of Corpsmembers in the EIE study becomes, 

1 

the greater the volume of data collected, transmitted, and stored. 
There have been minor di^fficulties with disk file storage space and 

with ability of- on-site | monitors to transmit data because of system 

I 
I 

overload. However, in flight of the large amount of information 
in the data base, data jcollection difficulties have been minor incon- 
veniences rather than major problems. The continued cooperation of 
all those. involved in the development and management' of the data 
collection sfyslfem has ^greatly facilitated itseffectiveness. 

'I 

The data file will cor'itain significant amounts of information on each 
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Corpsniember participating in the study. The demographic data on 
record will include all that is on the Job Corps screening sheet 
(ETA 6-52), plus model and attendance information. The test data 
file will contain date of test, name of test, form of test, raw 
score and number of class periods scheduled at the time the test 
was given. Test scores will be on file for all placement tests 
(i.e. RJSl HJSl, JCRPl) and for all evaluation instruments (i.e. 
SAT, GEO Practice Test, APL/ACT revised). The primary data forms 
are in the appendix to this chapter. 

In addition to the above-mentioned educational tests, a sample of 
Corpsmembers will complete process evaluation questionnaires. These 
questionnaires will contain questions pertinent to Job Corps and 
questions relating to specific model programs. Questionnaires 
relating to the impact of the model programs on both the Job Corps 
educational program and the center will be completed by teachers and 
Basic Education Directors involved with these programs. Because of 
the nature of these latter instruments, computer "scoring and tabu- 
lation is not possible. Therefore, these will be forwarded to the 
researchers at TEAM Associates, Inc. 



All of the data transmi.tted to TEF will be maintained in an active 
file until the Corpsmember terminates. Upon termination from either 
the model or the Job Corps program, a Corpsmember 's data will be 
placed in a termination file. All data will be retained iy TEF 
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pending other notification from the Department of Labor. 

All data to be collected will be compiled by the full-time monitor 
on-site and then forwarded to TEF. The specific data to be 
collected is dependent upon the particular model program and is 
delineated in Chapter 3 of this report. The interested reader may 
also consult the Data Collection Guide for Edt' national Improvement 
Effdrt Project (TEF, 1979) for further details. 

In general, however, the period of data collection begins when the 
Corpsmember arrives on-center and continues through one year, if the 
Corpsmdmber remains active. All test data, demographic data, 
attendaljce data- and drop-out data will be transmitted to TEF on 
a weekly! basis. Transmission errors will be noted by TEF and the 



monitors will resubmit the data. On-site printers will also give 
monitors a printout of their transmission. As had been previously 
stated, the EIE data file will contain enough data to enable many 
different types of analyses. Some of the specific analyses will not 
be determined until data from the first cohort in each model has been 
examined. As with other segments of this evaluation, the design for 
data analysis! IS model -specific. However, there are certain procedures 
which are general across most of the models. The measurement of 
educational ga'|ns by either SATs or GED tests is relevant to all 
models. Withiri site, 2 sample t tests will be used to determine 
whether or not there is a significant difference in educational gains 
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between programs. 

> 

In addition, the data bank will contain deroograpfjic as well as 
educational gains information on each participant. Therefore, 

Pearson Product Moment Correlations between [such demographic vari- 

j 

ables as sex, last grade completed, age, anfi race with educational 
gain will be calculated. These can be done for the entire sample, 
for a specific center or region, for a specific model, or for a 
combination of modisl and center. If preliminary data analysis so 
indicates, multivariate procedures will be used to discern which 
combination of demographic variables is the best predictor of 
educational success (defining educational success as either educational 
gain, attainment of GED, or other relevant variable). 

Insofar as the GED data are concerned, by the end of this study, enough 
programs will have been tried with a large enough sample in each to 
-enaWc-the -researchers to accurately calculate the percentage of 
enrollees in GED who successfully pass the state GEp exam. Infor- 
mation will also be available on the amount of time^Ljtakes a 
Corpsmember to obtain a GED. Further, with the use ofAPL, information 
on the percentage of Corpsmembers who desire a high school diploma 
rather than a GED should be available. This will enable the Department 
of Labor to make a decision regarding what should, Be done, if anything, 
in the way of expanding the diploma-granting capability of the Job 
Corps. / 



115 



The"^ analysis of the LD and Bilingual/ESL models is not based 
prinwirily on educational gains. Rather, with these two programs, 
the concern is \Ath increasing the Corpsmember retention rate. It 
will be possible to compare the percentages of early drop-outs between 
centers with and without these programs. This will enable the 
Department of Labor to make decisions rega/ding the feasibility of 
expanding these programs within Job Corps. 

The analysis of the computer programs (BTI, CMI and PLATO) will be 
based on Corpsmember educational gains and on other factors. 
Because of the cost of these programs, emphasis will be* placed on 
such things as increased Corpsmember motiviation and data management' 
capabilities. Therefore, the analysis here is concerned with overall 
capability in the center, not just with instructional capability. 

Because of the vastly different nature of the programs contained 
within this study and of the sites wherein programs are being 
implemented, the analysis of each model program will be done 
separately. Only in this way can each be given a fair and 
equitable evaluation. 

The EIE evaluation is a study of various types of educational 
programs. However, the success of those programs depends to a large 
degree on the perception of the Corpsmembers. Therefore, as a 
supplement to the basic EIE research, in-depth interviews will be 



' conducted with a small sariiple of experimental and control group 
Corpsmembers at each of the involved centers. The on-site 
Interviews will be conducted in these stages: 

Stage I - First 48 hours with the emphasis on how the 

Corpsmelfiber came to enter Job Corps and his/her 
initial perceptions. 

Stage II - 75 to 90 days with an emphasis on what has happened 
during this time and how the Corpsmember feel about 
the last 3 months. 

Stage III - Exist interviews wiith the emphasis on how ready the 
Corpsmember believes he/she is to enter post-job 
Corps life. 

The Corpsmembers who are interviewed for this phase of the EIE study 
will also be followed after they leave the Job Corps. There will be 
two followup interviews conducted with these individuals at 90 days 
anld 240 days after exit. . 

While information from these interviews will not be subjected to 
detailed statistical analysis, it should provide valuable data about 
strengths and weaknesses of the Job Corps program that cannot be 
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obtained from an objective-based questionnaire. These data will, 
provide an overall framework which would not otherwise be available. 
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REJECTED BY ARMED-FORBES 







YES..^ 


c:ln 


--NO 


c:2:> 


NOT APPLICABLE LEAVE BLANK 


IF SO, WHY? 






PHYSICAL 


c:1:j 


MENTAL 


c:2:> 


OTHER 


c:3:3 


NOT APPLICABLE LEAVE BLANK 


TYPE OF DISCHARGE 








HONORABLE 


c:1:3 


GENERAL 


c.-2:3 


UNDESIRABLE 


1:33 


BAD CONDUCT 


c:4:3 


DISHONORABLE 


1:5:3 


NOT APPLICABLE LEAVE BLANK 



RESIDENTIAL CODE 







LIVING ON CENTER 


c:l:3 


LIVING OFF CE^JTER 


1.2:3 



U2 



STATUS RECORD 


CENTER CODE 


cO:> k^j c::^> c:^) t:5» cryrj. e^ga e,-^ 




tO:i ttl:j t-Z:9 c;5> c:i^9 crgw c^. tzjn t:^ 




tO:> t:1:J cz^j c:4:> t:5w c:^ 




SOCIAL SECURITY NUMBER 




liy.i t:1:i i:2:> t:5j. c:4i c,-5n t^i tzjzi t:^ tlQii 




ti)zi r:l:> t:2:» c:^> c;4> c:5n cya er^j 




KliJ c:2:> c:5> c:4> c:7:i c:ft> 




c:l:> c:2:> r5» c:4> t:5:i c:8:> c:7n t:^ uQri 




fO:> tzy.i tzZi Ji^i Ji4?l_«:5n 1:0:1 kT^j c;^) k^j 




tO:j t:1:j t:2sj r.^i v.^i c:5» 1:6:9 ctftj 




t:l:i t.*2:J c:^> c:6a cga c:^ 




t^kr-trhj— 1;2:» tt^> t:*> c^n czCa^Tii't:^ 




cOj c:1:j c.2:> c:^* ti^^x^^ t:6a k7:> t:8> t:^ 




-KIODiLCODE 




e^> t:ln t:2r> t;J> r^s c:5;j c:^ «:7:> 0^9 ttc^i 




cO:> t:4:> «:5=> «^ ^8^ c:3:> 




cO:> t-^i c:4:> c:5:> r<:j c:7:> t:ft> c:^ 





NAME. 



JOB CORPS 
EDUCATIONAL IMPROVEMENT EFFORT 
STATUS RECORD 



m 



MODEL ENROLLMENT 
DATE 



JAN « J» 



MAYr :> 



JUN t: t> 



JUL c: :9 



AUQc: ti 



SEP c: » 



OCT c: :S 



NOVt: :> 



DEC t: :> 



K4n 



DAY 



t:7» c:7:> 



YEAR 



MODEL TERMINATION 
DATE 



JAN c: :) 



FEB u 1% 



MAR c: n 



APR K.a 



MAY K n 



JUN c: u 



AUG V, » 



SEP t: :) 



OCT K :> 



NOV c: i> 



DEC c » 



DAY 



YEAR 



STATUS 



«2» 



FORM 2143 JC 

7f0420 ' 7flS07 



TEACHER ^]UMBgR 



cQn c:l:> c:2:> t'^* vj^i c:S=> <7n c:ft> 



tO:> c;l:> i:2:> c;^> c:4:> c:5:> c:e:> «7?> c.-»i 



SCHEDULE CODE 



DAILY 



BIWEEKLY 



13 



[CORRECTION 



WEEKLY NUMBER OF PERIODS ASSIGNED IN THE MODEL 





tO:> t3:> t>4:i c5n c:6:> «^7» 








tO:> tC:> t:4:j t^y td^^ tijii t^n 








NUMBER OF CLASS PERIODS MISSED i 






tO'-i t;l:i t5:i cvJ:> t:4:i t5:> t6:> 








fO:> c^J:> k4:i i5:> t6:> 







NUMBER OF CLASS PERIODS CREDITED i ♦ ) 



rO:> tzy.i c:2i> <'4''» t:8:» tlQzi 



t^i c;i;» c;2:i ct^i ct^i cS;> c<:>' c:7;> c:9:3 
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TERMINATION RECORD 



NAME. 



Job corps 
educational improvement effort 

TERMINATION RECORD 



CENTER CODE 



c^:» c:l;a c:2-» ^6"' '=6^' »=7=> »y «9:' 

cO:a c;l;i c:2=» t^-' '=6=' '-T^' t:0^ 

CQ;? c:l;> ^:2^> c;3;> tz^j ti^zj t:^j tr/zi c;g:> cry? 



SOCIAL SECURITY NUMBER 



JCTERMINATION 
DATE 









JANc: :j 






F£B c: » 




c:i:> 


MARc: :) 






APR c: :» 






MAYc: :) 






JUN c: it 






JUL c: :) 






AUGn ;) 






SEP c: :» 






OCT e: 






NOVc:.:> 


DAY 


YEAR . 


OECc: :> 



TYPE OF 



t^z9 t',y,7 c:2^j 1:3:1 c^:) c^i cqg:) 17:9 1^:9 k^9 




c^:> c:):9 c:2^9 1:3:9 c^:9 k^9 1:5:9 1:7:9 t:g:9 c:g:9 




cO:> c:1:> c^*-' «^ «^ «^:> «^ 




cO:> c:2=' 1:9:) 




(^» c:l:9 c:2^9 c:$9 1:^9 c:5» t:^ ttyzt t:^ td^ti 




c:|:9 c:2t9 t:^) 1:^9 c:5:j c:^) txjzi v^.t^ 




tXP* t'.\'.9 c:2t> t'.^ tt^j t:5:9 t:^9 U7n i:^ 




cO:' c^' (^n c:^ 




t^i t'A'.j e:2:> c:Jj c:4> c6:9 K^r^ c:7n 





TERMINATlbN 


tftANSPgft ; ^ 


tz :9 


DISCIPLINARY 


t: 


AWOL i 


K :9 


ADMINISTRATIVE 


tt n 


MEDICAL-DEATH 


t: n 


TRANSFER ACT 


c: n 


RESIGNATION 


c: :9 


COMPLETER 


c: :> 


MAX BENEFIT 


t: :9 



CORRECTION 



TIME LOGGED ON THE COMPUTER, <caionly) 



tQ:9 cr|;9 c:y9 1:3:9 c:4:> c:y> 155:9 tr/ii 1:3^9 c:0:> 



cO;» t.-^;9 tl2i> tp:' ty> 

cO:> tQii ti^it f4:t td^9 t^n %rjznt^i c^9 
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-COMMENTS- 



! _ TEST RECORD 


CENTER CODE 


cC:> tzy.i t^.i r^i tU^zi c:5tj tzT^t c:^ u^j 




tX^ii c:1:j tt2zi r^i vJ^zi c:5: c:^j c:7:j c^j c:9^ 




tO:> t--?' «=4:» t:5-'' tz^^ tqzi 1:9:3 




SOCIAL SECURITY NUMBER % 


tO:> tz^i tz^i ^5:1 c:^. 1:7:1 c:^ crgra 




«--2?» c:5:j c:^j tzyzi c:^j k^j 




cO:> c:1:i tzZ* tz^i c:5:j c:^j c:7:j c:&j c:^j 




tO:3 c:l:i tzZi t:i> c:4> c:5:j c:&J c:7:j c:^j crgij 




cO:> c:1:> t-Z* r.^i 1:5:1 «:&> tzT-i c:^ 




tO> c:1:> tzTzi tz^i c:4:> c:5:i t:&j tzjii tz^i tz^i 




cC:)- c:l:): c:2:) t:$j"-t:4:j t:^ tryzi tzQ^i agpi 




tOri i:1:i 1:7:1 t:Jj t:4:> 1:5:1 c:^j tiyzi cigij c:^j 




't<):3 t:1:j tt2'-i tz^i tzA^i ti^ t:fyi tzyzi 





NAME 



TYPE OF TEST 



tC=> t:2=» tzAzi tg:i i:6:j 1:7:1 i^j is^t 



t^a t:1:» t^:i 1:^1 k^j i^u i:^:, c:7:j t^i t^i 









JAN tZ^Zi 






FEB t:2=J 


t:l:j tn:i 


t:i:j 


MAR trjii 


ti2^i tz2zi 




AP» c4:) 


cQiJ 1:3:1 




MAY 1:5:1 




tzAzi 




t:5:> 




JUL t:7:> 




t^z 


AUG t^i 


t:7:» 


tzT-i tqzi 


StP c:9:j 




tz^i c^i 


OCT ef^i 


c:^> 


tz^i tl^i 


NOV ^) 


DAY 


YEAR 


OEC C)29 



.... s 




P 1 






f 


cC:j 






c:1:j 




















c:4^ 


















t:7a 


«73 










c:^3 





JOB CORPS 
EDUCATIONAL IMPROVEMENT EFFORT 
TEST RECORD 



PRE. TEST 
POST. TEST 



tt):> «:2i> «4:3 t:7:j c:^! c^j 




c:0:> .k25> *:i> «54:> Kg:* t:5:j t:7» c:&i 




G.E.O, SOCIAL STUDIES SCOft T 


CO?) tti:) k:2:> t:4:) vfy^ c:7i9 u^i tr^i 




c^) c:1:) c:2:) c^) c^i c6:) c^^) u7:) c:^ cSrs 




G.E.D. SCIENCE SCORE 


tO:i t:2:J tz^z K^i t:5:j ciftj t:?:* t:8^ t^j 




t:2:> cr5:i c:^:) t:?:) t^^) t:9:) 




G.E.O READING SCORE 


tO:i t:l:i 1:3:1 1:3:1 1:4:1 t:5ci t:6» t:?:^ 




t:0:i t:i:j t:2:i t:JJ t:^J t:5:j v!^% tzjit t:9» 




G.e.D. MATH SCORE 


tX^ tzy.i tt2:i tz^i tiA;i t^t tzQii tzla tzQa 


_J 


tX):i tzUi ttZzi tz^i c:4:a c:S:> tzQa c:7:) c:^ ttQit 


1 
1 


G E D TOTAL SCORE 


tC:> tzy.i ti2> tt3:i tz^a tz^t t^i t:7:j t^j tz^i 




cO:> c:1:) (^2:) t^:) c:4:>*c:5:s t^i c:7:3 ct&2 




!<>:) c:1:) t:2:} c:^) c:4:) td5ii crGc) c:7:) t:&3 




STATE CODE OF G E O. EXAM 


1:2:3 t:3:3 tzAm eg:) «:7:3 tz^i 




^:1:> «:2:3 t:5» tzAsi tz^i trfirj c:7:3 «:&> tzQa 




TIME LOGGED IN COMPUTER (CAI ONLY) 


tiy.i c:1:i c:2:3 t:^) c:4:> cSc) c£:) c:7n tz&i c^i 




tO:j t:1:J t:2:j v.^i i:4> f:5:j i£:j c:7:j c:8:> 




IC:> «:1:> «^:> «:5> «:4:> «:5:> «<:> «:7:> «:&> «:9:3 





FORM 2144 JC 

791017 791017 



«: :> DELETE 



CORRECTION 
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BASIC EDUCATION DIRECTOR PROCESS EVALUATION QUESTIONNAIRE 



ERIC 
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BASIC EDUCATION DIRECTOR PROCESS EVALUATION QUESTIONNAIRE 

MONITOR INSTRUCTIONS 

/ 

This questionnaire is designed to be given in an interview setting. All 
of t^ questions require open-ended responses. Please write down as 
mucH as you can of the response; if you can not get it all down, please 
A"""®. ^° *"y crucial information. The completed 

questionnaire is then to be forwarded to the researchers at: 

/ 

t 

J 

I 

TEAM Associates, Inc. 
; Suite 510 

j - 1625 I Street, N.W. 

; Washington, D.C. 20006. 

: The questionnaire should take about one hour to administer and is to be 
i given at the end of the first cohort for each model program. Please 
\ tell the Basic Education Director that we realize the questionnaire may 
get repetitive if there is more than one tnodel program on center, but the 
only way we can insure a complete evaluation is to request that he/ 
she respond for each program. 
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'Name 
Center 



Basic Education Director 
Process Evaluation Questionnaire 



Has the center had to spend any additional money because of the 
pilot testing? 

a. Yes 

b. No 

If "yes"* on what was the money spent? 



How much money was spent? $ 



Has the experimental program had any effect on thisschedul ing of 



teachers? 

a. Yes 

b. No 

If "yes", what chanjei had to be made? 



had to be 



Has the experimental program had any effect on the -schedulinq of 
corpsmembers? " 

a. Yes 

If "yes", what changes had to be made? 



b. No, skip to question 5. 



14^ 



If you had to reschedule students to pilot test this program, how 
workable have you found the new schedule? . „ 

a. Very workable; new schedule presents no major pf obi ells ^alid the- 
center should continue this schedule. 

b. Workable, but still have some problems. 
Please explain 



c. Not workable, ^ot beneficial to corpsmembers or staff. 
Please explalj _^ 

i 



Who chose the /teachers who participated In the experimental i/rpgram? 



t 



The following are possible criteria used In teacher selection. Please 
rank thein In order of how Important they were to whomever /selected 
participating teachers. (Please use "0" If a criterion wis not a 
consideration.) / ' — 



a. • 1^ - teacher's excellence as a teacher ^ . J 

b. teacher's desire to participate / 

c. teacher's availability 

. J. 

d. teacher's l^nowledge of specific subject area 

e. . oth6r (specify 
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7. What staff members (other than teachers and the basic education 
director) have been involved with the pilot test? 



ERIC 



8. How were these staff jnetbecs chosen? 



9.- How were these staff members utilized? 



10. Did the materials, equipment, and/or personnel for the experimental 
program arrive when they were expected? 



a. Yes 

b. No 



11. Was it necessary for someone at the center to follow up u. the 
materials In order to ensure their arrival? 

a. Yes. What did the follow-up Involve? 



b.. No 



13. Did the fact that the experimental program had to be kept discreet from 
the rest of the center pose any problems? 

a. Yes. Please explain • 



b. No 

131 



14. Did corpsmembers who were not in 
any interest in the programT" 

a. Yes 

b. No 

If yes, how was this handled? 



the experimental group express 



9 



15. Did corpsmembers who were n6t in the experimental program express 
any resentment at not being allowed to participate in the program? 

a. Yes 

> b. No ' 
If yes, how was this handled? 



Please describe teacher feedback regarding this model, 

a. Did teachers see it as beneficial for the students involved? 



b. Any negative fsedback? 



17. Would you be willing to continue this program at the center? 
Why or why not? ; 



a. Yes 

b. No 
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1 



so 



18. Would you recomnend this program for use throughout Job Corps? 

a. Yes 

b. No 

Why or VJiy not? 



19. Is this program applicable to the needs of Corpsmembers? 

a. Yes, definitely 

b. Somefwhat 

c. No, not at all 

On what are these cormients based? 



20. How would you rate teachers' attitudes toward using the program, 
before it began? 

a. Everyone was very positive 

b. Most teachers were positive, but a few were negative 

c. They were neutral 

d. Most were negative, but a few were positive 

e. Everyone was negative 

21. Did attitudes change after using the program? 

a. Nearly 'everyone became more positive 

b. Little or no cnange 

c. Nearly everyone became more negative 



ERIC 
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is: 



22. 



In general, how easy was the program to implemeri 



J 2 3 4 5 

Very easy Very hard 

23. Would you like to use this program instead of the current 
corresponding Job Corps program? 

a. Yes 

b. No 

Please explain ' 



24. How does this program affect the amount of paperwork with which 
the teachers must cope? 

a. Increases paperwork 

b. Decreases paperwork 

c. Has no effect 

25. How does this program affect your paperwork? 

a. Increases, paperwork 

b. Decreases paperwork = 

c. Has no effect 

26. Was the training of teachers comprehensive enough? 

a. Yes; after training teachers could use the program with no 
probl em 

b. Yes; there were a few gaps in training, but they were quickly 
ironed out. 

c. No; it took some time after training before teachers really 
understood the program 

d. No; training was totally inadequate 

134 
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27. Has this experimental program made any changes in students 
self-confidence? 

a. Increased their self-confidence 

b. No perceptible change 

c. Decreased their self-confidence 



28. Did the amount of testing required By the program present any 
problems? 



a. Yes. Please explain 



b. No 

For models involving the use of machines (i.e. computer terminals 
video tapej etc.^. please answer the following . Otherwise, skip to 
Qustlon 33 . 

29. Did the machine(s) work dependably? 
.a. Always (skip to #32) 

b. Sometimes 

c. Never 

30. When it did. break down, how quickly was it repaired or replaced? 

a. The same day 

b. The next day 

c. Within 'a week 

d. Longer"than^a week 
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31. Did this breakdown disrupt the program? • " 

a. Severely 

b. (Moderately 

c. Minimally 

32. When corpsmembers were using the machine, how much teacher super- 
vision was needed? 

a. A great deal 

b. Some 

Very little 

d. None 

33. ' Based on what has happened to this center because of this model 

program, would you be willing to participate in another experiment? 

a. Yes * ' 

b. No 

Why or why not? ^ ^ 



34. Do you think your staff would be willing to participate in another 
experiment? 

a. Yes ' * 

b. No 

Why or Why not? • 
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35. If there are any additional comments which you would like to make» 
we would be glad to have them. ^ 



THANK YOU FOR YOUR TIM" 
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TEACHER PROCESS EVALUATION QUESTIONNAIRE 
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TEACHER PROCESS EVALUATION QUESTIONNAIRE 
DIRECTIONS FOR ADMINISTRATION 

SAY- i AM GOING TO READ SOME STATEMENTS TO YOU. FOR EACH OF THEM. 
PLEASE TELL ME WHETHER YOU: 

STRONGLY DISAGREE 

DISAGREE 

AGREE 

STRONGLY AGREE 

REMEMBER. YOUR CHOICES ARE: STRONGLY DISAGREE. DISAGREE. AGREE. 
AND STRONGLY AGREE. 

(Hand the teacher the card with. the responses written on it which is 
to be used during the questionnaire administration.)' 

You will note as you read through the questionnaire that certain questions 
have an asterisk {*) precece ding than. This notation is for coding of 
responses. The responses should be coded directly onto the questionnaire 
form while it is being adninistered. The response codes are as follows: 

Statements with no asterisk Statements with asterisk 



Response Code Response Code 

Strongly Disagree 1 Strongly Disagree 5 

Disagree 2 Disagree 4 

Neutral 3 Neutral 3 

Agree 4 Agree 2 

Strongly Agree 5 Strongly Agree i 
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The response codes take into account the positive or negative nature of 
the statement and must be properly coded if accurate analysis is to be " 
possible. It should also be noted that a high total score represents 
a positive attitude toward Job Corps. 

In addition, please note' that a code has been left for no opinion for 
each of the questionnaire statements. This response code is to be used 
sparingly. The respondent is not aware that a "No Opinion" response is 
possible and should be' encouraged to respond openly and honestly to 
each statement. The'fleutral Code (3) should be used only if the 
respondent really 'has no opinion. 
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TEACHER QUESTIONNAIRE 



Name_ Model 



Center Date - 



THE FOLLOWING STATEMENTS ARE TO BE RESPONDED TO BY ALL E XPERIMENTAL 
TEACHERS . 

/ ^ 

1. Trying out new programs is good for the Job Corps 
educational program. 

2/ Job ^orps enrol lees are eager to learn. 

/3. I hlvp very little influence on how a student 
/ lea.rniv 

/ 4. The majority of corpsmembers are really^ interested 
In -improving themselves. 

5. Most teachers would like to be part of an 
experimental program. 

I 

^ *6. Teaching in Job Corps makes me feel that I am 
accomplishing very little. ' . ^ 

7. Teaching in Job Corps is both interesting and 
ch. lenging. 

8. The experimental programs which 'I know about seem 
to be worthwhile. 

9. The new models, restore my interest and enthusiasm 
concerning teaching in Job Corps. 

*10. I feel that using programmed learning materials 
gets boring quickly for a teacher. 

The paper work generated by the new Job Corps 
programs is too heavy a load for a teacher. 

12. I could teach more effectively if I had a 
corpsmember assistant. 

13, All centers should be using these new programs. 



ERIC 
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ADKINS 



14. 

15. 
*16 

17. 

,18. 
*19. 

20. 
*21. 

22. 

*23. 

*24r 

25. 
*26. 

27. 



ERIC 



The. Adkins program was relatively easy to implement 
i.D„..the...cIa.S.sroom. 

Adkins was an interesting program for a teacher to 
work with. 

Tjie training which I received was not adequate to 
enable, me to implement the program well. 

Corpsmembers seem to like the Adkins program better 
than the regular Job Corps World of Work program. 

Adkins is appropriate for more widespread use in 
Job Corps. 

The students were no more motivated in Adkins than 
they have'^-been in the regular World of Work program. 

The group process is helpful in reinforcing the 
learning process through peer feedback. 

The four-stage learning sequence used in Adkins is 
not very effective. 

Videotaping of students helps them to develop the 
skills and behaviors which they need to get and 
keep a job. 

The student p'-esentrtions are not effective in 
terms of building student self-confidence. 



Major modifications to the program will be necessary 
before it will fit into Job Corps well. 

1 would like' to continue working with the Adkins 
program. 

The skills needed to successfully operate this program 
are more akin to those of a counselor than a 
classroom teacher. 

I feel capable of training-other Job Corps teachers 
in the use of Adkins. 








API 



14. The API program was relatively easy to implement 
in the classroom. 

15. API is an interesting program for a teacher to 
work with. 

*16. The training whicfy I received was not adequate 
to enable me to implement the program well. 

17. Corpsmembers seem wilke the API program materials 
better than the regular Job Corps materials. 

18. API is appropriate for more widespread use in 
Job Corps. 

*19. The students were not more motivated in API than 
they are in the regular Job Corps program. 

20. The modules were easy for the corpsmembers to 
understand. 

21. Corpsmembers seemed to progress more rapidly 
through thft API program than the regular Job 
Corps program. 

V 

I 

22. The lessor content was more motivating for the 
syudents than the regular Job Corps program content. 

23. The diagnostic tests were able to place students 
accurately wjthin the curriculum. 

*24. Wajor modifications to the program will be necessary 
/before it will fit into Job Corps well. 

25. / 1 would like to continue working with the API 
program. 

I feel capable of training other Job Torps teachers 
in the use of the API program. 
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APL 



14. The APL program was relatively easy to implement 
in the classroom. 

15. APL is an interesting program for a teacher to 
work with. , . • 

*16. The training which I received was not adequate to 
enable me to implement the program well. 

17. Corpsmembers seemed to like the APL^^ogram materials 
better than the regular Job Corps program materials. 

IS. APL is appropriate for more widespread use in 
Job Corps. 

*19^ Students were no more motivated in APL than they 
are in the regular Job Corps program. 

20. Vocationally-oriented materials have a definite 
^ . tplace in the Job Corps curriculum. 

^ », 

21. APL" teaches students to read more effectively than 
the regular Job Corps reading' program. 

22. APL teaches math more effectively than the regular 
X Job Corps math program. 

23. The possibility of getting a high school diploma seems 
to itjotivate corpsmembers to learn more rapidly than 
th^y do when a diploma is not availdale. 

24. Major modifications to the program will be Fiecessary 
before it will fit into Job Corps well. 

25. I would like to continue working with the APL 
program. 

26. I feel capable of training Mother Job Corps teachers 
in the use of the APL program. 
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CAI COMPLcTE 
PLATO/BTI 



14. The computer program was relatively easy to implement 
in the class»"oom. 

15. The computer is a very valuable iristructional tool 
for a teacher to work with. 

*16. The training which I received was not adequate to 
enable me to implement the program well. 

17. Corpsmembers appear to be moi'e motivated^tp learn on 
the computer than with paper and pencil alcnc;. 

18. Computers are appropriate for more widespread use 
in the Job Corps educational programs. 

19. There were enough terminals for the students to use 
when they needed CAI time. 

20. Students seemed to progress more rapidly using the 
computer than they do in the traditional programs. 

21. There was not much "down" time for the cbmputers. 

22. Students liked the fact that others did not know 
when -hey made a mistake. 

23. The training which the students received in computer 
operations was adequate. 

24. I would like to continue working with the computer 
instructional program. ' 

25. The CAI system relieves the teacher of most of the 
^ onerous paperwork associated with programmed 

learning. 

26. My time is no more efficiently used in a CAI class- 
room than in a regular paper and pencil classroom. 

27. I feel capable of training other Job Corps teachers 
in the use of this computer-assisted instruction 
program. 
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CAI MATH 
^ . CLASSMATE 88 



14. The Classmate 88 was relatively easy to use 
within the regular classroom structure. 

15. Classmate 88 is interesting for a teacher to use 
as a classroo:n aid. 

*16. The training which I received was not adequate to 
enable me to implement the program well. 

17. Corpsmembers sesm to like working on the Classmate 88 
better than the regular paper and pencil method alone. 

18. Classmate 88 is appropriate for more widespread use 
in Job Corps. 

*19. Students were no more motivated using Classmate 88 
than they are in the regular Job Corps math program. 

20. Students liked the fact that others did not know 
when they had made a mistake. 

21. There were enough Classmate 88 calculators for the 
students to use as often as needed. 

22. A niath aid such as Classmate 88 enables students to 
progress through the prociram more rapidly than they 
do without the supplemental aid. 

*23. As an instructional tool. Classmate 88 does not do 
enough to warrant the high cost of the equipment. 

*24. Major modifications will have to be made before the 
Classmate 88 will fit into .Job Corps well. 

25. I would like to continue working with the Classmate 88, 

26. Not having to locate or compose and correct drill 
exercises contained on the Classmate 88 enabled me 
to use my teaching time more efficiently and 
effectively. 

*27. A better diagnostic testing program is needed to make 
the Classmate 88 program more effective. 

28. I feel capable of training other Job Corps teachers 
in the use of Classmate 88. 
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CAMBRIDGE GED 



14, The Cambridge GCD program was relatively easy 
to implement in the classroom, 

15. Cambridge is an interesting program for a 
teacher to work with. 

*16. The training which I received was not 
adequate to enable me to implement the 
program well. 

17. Corpsmembers seemed to like 'the Cambridge 
program better than the regular Job Corps 
GED program. 

18. Cambridge is appropriate for more widespread 
use in Job Corps. 

*19. Students were no more motivated using Cambridge 
than they are in the regular Job Corps 
GED program. " 

20. The videotapes were easy for the corpsmembers 
to understand. 

21. The workbooks and other instructional aids 
provided enough additional help when the 
corpsmember needed it. 

22. The mastery tests seem to help the corpsmember 
get ready for the State GED exam. 

23. Videotapes should be used more extensively 
in Job Corps. 

*24. Major modifications to the program will be 
necessary before Cambridge will fit into 
Job Corps well . 

25. I would like to continue working, with the 
Cambridge GED program. 

26. I think more students will pass the State GED 
exam using this program than with the regular 
Job Corps GED program. 

27. I feel capable of training other Job Corps teachers 
in the use of Cambridge GED. 
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NEW READING PROGRAM^ 



14. The new reading program was relatively easy 
to implement in the classroom. 

15. The new reading program is interesting for 
a teacher to work with. 

*16. The training which I received was not adequate 
to enable me to implement tlie program well. 

17. 'Corpsmembers seem to like the new reading program 
better than the old Job Corps program. ' 

18. The new reading program is appropriate for use 
throughout Job Corps. 

*19. It is taking students so much longer to get through 
each level of the new reading program that their 
motivation is low. 

20. The placement procedure for the new reading program 
is efficient. 

21. The placement procedure for the new reading prografn 
is accurate. 

22. Corpsmembers react well to the Language/Study 
Skills assignments. 

23. Corpsmembers feel that the reading selection content 
is appropriate for them. 

*24. Major modifications to the program are necessary 
before it will fit into Job Corps weil. 

25. I would like to continue working with the new 
reading program. 

26. I feel capable of training other Job Corps teachers 
in the use of the new reading program. 
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STAFFING 



14. Integrating the aides into the classroom was 
relatively easy. 

^t is interesting for a teacher to be able to 
' with classroom aides. 

Ttie tfainin^-wirich the aides received was not 
adequate to enabTe~4hem to function effectively 
within the classrooni>- 

17. Corpsmembers seem to like having aides in the 
classroom. 

18. The use of aides is appropriate throughout 
Job Corps. 

*19. Using aides had no more effect on student moti- 
vation than not using ald-js. 

20. The aides appear to interact well with Ihe 
students. 

21. The aides enabled me to spend more time directly 
working with students. 

22. Corpsmembers s^eemed to accept the aides without 
any problem. 

23. There are many more areas in Job Corps where 
aides could be used effectively. 

*24. , Major modifications in aide responsibility will 
be necessary before aides can be adequately 
utilized within" the Job Corps. 

25. ' I .would like to continue to work with classroom 
—aides. 

26. Corpsmember aides are well worth the money used 
to employ them because they enable the teacher 
to function more effectively and efficiently 
within the classroom. , 

27. I feel capable of training other Job Corps teachers 
in the appropriate use of aides within the 
classroom. 

4 




PLEASE RESPOND TO THE FOLLOWING QUESTIONS WITH AS MUCH DETAIL AS . 
POSSIBLE, THESE QUESTIONS ARE TO BE ANSWERED BY ALL THE EXPERIMENTAL 



TEACHERS, 



!• Specifically, what changes in the training which you received 
would make it easier for new teachers coming into the program? 



2. Specifically, what modifications would you feel should be made 
in order for the program to function more effectively within 
the Job Corps? 



3, After your experience as part of this experiment, would you be 
willing to participate in another experiment? Why or why not? 



4, Insofar as the time and money that was spent In developing these 
models is concerned, was it well spent? What else do you feel 
should be done? 



5, Are there any additional comments which you would like to make? 
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Corpsmember Process Evaluation Questionnaires 
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Core Questions . 



I learn things quickly. 



I. 



I enjoy learning* 



3* 



I learn faster in Job Corps than In school. 



4. 



People could have a better life with more education. 



- 5. Job Corps is helping me learn things to make my future better. 

6. Teachers in Job Corps care more than teachers in school. 

7. You need math to get a better job. 

8. Tm glad I entered Job Corps. 

9. You need to read to get a good job. 

10, I am treated fairly by Job Corps teachers. 
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Adkins Program 



11. I like having lessons op television. 

12. The programs were easy to understand. 

13. The things I learned will help me get a better job when I 
leave Job Corps. 



15. I think I learned how to keep my job through this program. 

16. I wish more of the Job Corps program was presented like this. 

17. Seeing myself on television help me learn how I look and 
sound to others. 

18. After taking this program, I am not afraid of a job interview 

19. Because of this course, I feel I can take better care of my 
money when I leave Job Corps. 

20. My teachers had time to help me when I needed it. 

21. I think I am learning faster in this program than my ^r^iends 
in the regular Job Corps program. / 

22. My teacher liked using the Adkins program. / 

23. The Adkins materials were interesting. / 

24. The Adkins materials are not too immature /or my age group. 



The group discussions were interesting. 
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APL Program 



11. The things I learned in APL will help me get a job. 

12. Going out into the community gave me confidence in getting a 
good job. 

13. I w£S able to get through the materials at my own speed. 

14. I liked the fact that the APL program can help me get a high 
school diploma. 

15. Because the materials were job-related, I wanted to learn more. 

16. More people would want to come to Job Corps if they knew they 
could get a high school diploma. 

17. My teachers had enough time to help me when I needed it. 

18. The APL materials are not too immature for my age group. 

19. My teacher liked using this program with us. 

20. I think I am learning faster in APL than my friends in the 
regular Job Corps program. 
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CAI 



11. Working with a computer makes me feel smart. 

12. I would like to be able to spend more time on the computer. 

13. I like the fact that on the computer, other people don't know 
when I make a mistake. 

14. I would rather work wiih a computer than a teacher. 

15. The computer lets me work at r^y own speed. 

16. The programs on the computer make me want to work harder. 

17. The computer should be used more in Job Corps. 

18. My teacher really like working with the computer. 

19. The materials on the computer were not too immature for any 
age group. 

20. I think I am learning faster on the computer than my friends 
who are not using it. 

21. My teacher had enough time to help me when I needed it. 

22. The computer was not off so much of the time that I couldn't 
use It when I needed to. 
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CAI Math Program 



11 • I woulo like to be able to spend more time working with 
/ / 
the/ciasssmate 88, / 

12, Xf4 directions for working with the Classma-te 88 are cle 

13, /working with equipment like the Classmate 88 makes me 



L 



/ 



15. 

16. 

17. 
18. 

19/ 

/ 

/■ 

/20. 
2]. 



feel smart, 

/ 

The problems on the Classmate 88 were' not boring, / 

/ 

I like the fact that when I work op' the Classmate -88, other 



people don't know when I make a n)i stake. 



/ 

/ 



Machines /like the Classmate 88 should be used more In Job 
Corps,/ / / 

Clas^ate 88 lets me work at/ny own speed, / 
Classmate 88 was not byoken so much that I coildn't 



t when I needed to. 



/ 



use 



The problems on Classmate 88 are not too immatur]'e for my age 
group, / I 

V\y teacher had enough/time to help me when I needed it, 
I think I am learning^ faster on the Classmate 8^ than my 
friends who are not using it. 



22, My teacher seemed to like working with the Clas'smate 88. 
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Cambridge GEO Program 



I like having lessons on television. 
The programs were easy to understand. 

The other materials like books and study guides gave me enough 
help when I needed it. 

The television lessons were interesting to me. 

I could not have gone through the program faster without the 

television lessons'. 

Programs on television should be used more in Job Corps. 
I think 'I am learning faster using Cambridge than my friends 
who are not Msing it. 

•My teacher liked using^ the Cambridge materials. 
The Cambridge materials are not too iimature for my age group. 
My teacher had enough time to help me when I needed it. 
The tests that were used in the books helped me to get ready 
for the GEO test. 
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NRP Program 

n* The language and study skills portion of the program is helpful 

12. It is not taking me longer to get through the program than I 
thought it would. 

13. The materials Lhad to read covered enough different things to 
keep me interested. 

14. I like to read for fun more now than I did when I came to Job 
Corps. 

15. The things I read in my old school were not as good as the 
things that I am reading in Job Corps. 

16. ^^y teacher had enough time to help' me when I needed it. 

17. The reading program materials are not too immature for my 
age group. 

18. By the time I finish this program, I will really be ready for 
the reading part of the GED. 

19. My teacher really like working with the reading program. 

20. I think I am learning fester than my friends who are in oth^r 

/ 

Job Corps reading progr=ims. • 
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staffing 

n. Having aides helped make the classes more interesting, 

12. I went 'through the program faster because the^ldes were 
there to help me. 

13. I got enough attention from my teacher even though there was 
an aide. 

14. Aides should be used more in Job Corps. 
- 15. My teacher really like having the aide. 

16. The aide respected me as a person. ' 

17. There were enough aides to help everyone when they needed it. 
18.. I think I an learning faster than my friends wha are in classes 

without aides. 
.19. On§ day I would like to be an aide. in Job Corps. 
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c CHAPTER 6. PRELIMINARY FINDINGS 

The EIE is an evolving system of experiments. The first model program 
began in May 1979. Since then, as Phase I of EIE, nine programs have 
been implemented at nine Job Corps Centers, with some data available on 
these experiences. 

Between the testing of the first participant in April 1979 and March 
1980, 2,268, experimental' program enrol lees and 1,875 control program 
enrollees were assigned to different model; in tie EIE study. Of these, 
394 part icii)a ted for 90 hours of program confer, and were tested before 
and after; 1,841 enrollees exited from the programs before the completion 
of 90 hours. Of this latter group, 349 were tested on early exit. The 
average number of program hours for^ the groups exiting early was 35.6. 
There were 906 active enrollees with less than 90 hours of treatment as 
of the beginning of March 1979. For the period covered by this report, 
2,405 enrollees have t^nninated from the EIE study for a variety of 
reasons, i.e. either leaving Job Corps or progressing far enough where 
the experimental programs were no longer applicable. The data presented 
in Table 15 is largely self explanatory. However, a few clarifications 
have to be made. Insofar as the Adkins program is concerned, the 
shortened version (7 units rather than 10), does not take 90 program 
hours to complete. Therefore, pre and posttest data largely show in 
the early terminee category. The API program was suspended and begun 
again due to numerous site problems; therefore, it has not been in 
operation long enough for data in the later cohorts to be available- 
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Table 15 
Summary of Experience 
April 1979-March 1980 



Chartcterfstlc 


Adkins 


Adkins 
Control 


API 


API 
Mr 1 

Control 


APL 


ADI 

Control 


LAI 
Phoenix 


CM 
Plato 


TA I 

LAI 

Hath 


CAI 

Math 

Cont. 


Cambridge 
GEO 


Cjmbndge 
GEO. Cont. 


NRP 


NQD 

Control 


Staffina 


Total 


ToUl Entrants 


47 


65 


105 


' 89 


52 


48 


120 


237 


67 


60 


97 


87 


1201 


1524 


352 


4.151 


Total Terminees 


40 


55 


21 


22 


13 




40 


102 


60 


60 


48 


42 


764 


947 


184 


2.405 


iiiotal Active 


7 


10 * 


84 


67 


39 


41 


\ 80 


135 


7 


0 


49 


45 


437 


577 


168 


1.746 


CxUed Before 

* 90 Hours 


J7 


51 


4 


19 


4 


1 


-39 


54 


''33 


42 


23 


13 


581 


826 


112 


1.841 


Tested on 
cirly Extt 




22 


^ 0 


0 


1 


0 


6 


16 


14 


16 


SAT Not 
Appl icable 


99 


109 


46 


349 


Average Honrs Before 
Temination (90 hrs 
OP Usil ^ 


46 .9 


31. 9 


20.6 


22.8 


43. C 


44.0 


3K7 


53.0 


33.7 


35.9 




52.8 


38.0 


31.8 


49.2 


38.23 


i£>i,v{j ov nours 


7 


3 


6 


7 


1 


1 


8 


19 


6 


4 


56 


11 


110 


131 


22 


394 


Not Conipleted 
yu ffours as ot c/ou 


1 
1 


Q 


82 


66 


7 


11 


55 


4t 


5 


8 


12 


9 


203 


346 


50 


906 


Completed 90-135 Hours 
fjot Posttested 


1 


0 


0 


3 


8 


16 


8 


2 


2 


0 


7 


3 


18 


76 


5 


149 


Tested Between 135 and 
165 Hours 


Coh 
Com' 


lort 1 
Teted 


Proc 
Opef 
lone 


)ram Not 
'ational 
1 though 


"6 


1 


Program 
Suspend- 
ed 


3 


Program 
Terminated 
N/A 


4 


1 


64 


35 


19 


133 


Still In Program* 
150 Hours or More 












34 


35 




53 








4 


17 


114 


80 


53 


390 


Terminated at 150 Hours 
or More 












0 


0 




6 








19 


3 


5 


1 


3 


37 


Still in Program More 
than 165 Hours 












12 


9 




5! 








3 


16 


54 


&7 


34 


226 


Posttested at More than 
165 Hours 












6 


4 




15 








17 


15 


36 


27 


13 


133 


In Program at 1 Year 
















L 




17 












Tested at 1 Year 
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The CAI program at Phoenix has been in suspension since December 1979 
because of hardware difficulties.- Therefore, later cohort information 
is not currently available. In addition, the> CAI Math model has been 
terminated because of numerous site and program re.ated difficulties. 
Thereforf;, there is virtually no data available for more than 90 hours 
because the program was not in operation long enough. In addition, 
average hours in program are not currently available for any group other 
than the less than 90 hour terminees. This information will be 
available as the study progresses. 

-The data discussed in this report represents a preliminary investiga- 
tion on those Corpsmembers who have been enrolled in EIE Phase I from 
its inception in May 1979 up through February 1980. Included, there- 
fore, is only the first cohort of enroll ees in a limited number of - 
educational models and for a limited duration of individual partici- 
pation. 1 

The purpose of this report is to examine preliminary Phase I data to 
ascertain preliminary trends in che data in order to develop an 
analytical format that can be utilized as data accumulates subsequent- 
ly. In addition, pr el i mi nary "data have been examined in order to 
ascertain relevant predictors for selected outcome variables. It 
should be noted that the EIE study has not progressed far enough to 
provide sufficient sample sizes for analysis at man> of the test sites. 

Table 16 presents the demographic characteristics of experimental 

162 



ERIC 



182 



and control groups in percentages, by center, and by program within 
center. An inspection of the data indicates heterogeneity for most 
of the variables across the centers, indicating that the different 
demographic variables of Job Corps centers do vary within the re- 
straints set by the eligibility requirements. 

As for within center demographic variable differences, the following 
are statistically significant: 

1) At Breckinridge the number of males and females differ in 
the treatment programs. 

r 

2) At Guthrie the number of males and females differ in the 
two programs. 

3) The Clearfield PLATO program has significantly more whites 
in it in comparison to other programs. 

4) -At Tongue Point, the Cambridge GED program has significantly 
more whites in it. 

5} At Breckinridge, the CRP program has more Corpsmembers from 
towns over 250,000 than the other .programs do.^ 
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Table 16' 



Characteristic 



JSex: 
H«1e 
Female 

f Ethnic Group: 
Amer. Ind. 
Asian 
BUck 
Hisp. 
Uhlte 
Other 
^Slze of Town: 
Under 2.500 
2,500-50.000 
50.000-250.000 
O^er 250.000 
English Comp.: 
Good 

Fair/Poor 
None 

Residential Status: 
Res. 

Hon res. 
;Ust Grade Coiiipl.: 
J 
sd 
N 

Age: 
T 
Sd 
N 

Lang. Spoken: 
Awer. Ind. 
Other 
Spanish 
Eng, 



Sample Characteristics 
Selected Demographic Variables 



Total 



Breckinridge {N»631) 

Cantb 

NRP ORP Staff GEO 

INJ (N) (N) (N) 



180 igS 172 



79.2 
20.8 

.2 

97.6 
.5 
1.7 



81.1 
18.9 



98.9 
1.1 



77.4 
22.6 



97.9 
2.1 



81.4 
18.4 

.6 

98.3 
1.2 



45 



71.1 
28.9 



95.6 



4.4 



JC 
GEO 
(N) 



39 



79.5 
20.5 



89.7 
2.6 
7.7 



C 1 earfield (N>467) 



Totally PLATO NRP ORP Staff 
m <N) (N) ( N) 



10.0 


10.0 


8.7 


11.6 


13.3 


5.1 


6.4 


6.8 


5.1 


7.9 


5.0 


43.4 


46.1 


43.1 


44.2 


35.6 


38.5 


21.7 


2!. 5 


19.0 


23.6 


22.5 


24.7 


26.7 


21.5 


27.3 


24.4 


20.5 


18.3 


;o.5 


17.7 


18.0 


13.8 


21.9 


17.2 


.26.7 


16.9 


26.7 


35.9 


53.6 


5\2 


58.2 


50.6 


58:8 


88.4 


87.8 


86.2 


91.3 


88.9 


89.7 


86.6 


86.8 


89.9 


82.0 


87.5 


11.6 


12.2 


13.8 


8.7 


11.1 


10.3 


13.2 


12.8 


10.1 


18.0 


12.5 














.2 


.4 mis 








100 


100 


100 


100 


100 


100 


100 


100 


100 


100 


100 


9.7 


9.6 


9.8 


9.8 


9.5 


9.8 


9.8 


9.9 


10.0 


9.8 


9.8 


K3 


1.6 


1.2 


1.4 


l.P 


1.0 


1.0 


1.0 


1.0 


1.3 


1.0 


631 


180 


195 


172 


45 


39 


470 


210 


79 


89 


80 


18.4 


18.3 


18.5 


18.4 


18.0 


18.4 


18.3 


18.0 


18.4 


18.5 


18.4 


1.6 


1.6 


1.6 


'1.6 


1.5 


1.6 


1.6 


1.7 


1.3 


1.7 


1.5 


630 


180 


195 . 


172 


A4 


39 


465 


216 


79 


88 


79 














1.9 


1.8 


2.5 


3.4 




.4 


1.2 










.6 


1.0 




2.2 


1.3 


.3 




.5 






2.6 


9.1 


5.9 


11.4 


15.7 


8.8 


99.4 


98.8 


99.5 


100 


100 


97.4 


83.3 


92.2 


86.1 


78.7 


90.9 



83.0 
17.0 

4.3 
.5 
63.8 
10.0 
21.3 



8U7 
18.3 

4.1 
.5 
58.4 

7.8 
20.8 



79 89 



80 



8ai^'=^^85.4 '82.5 
T6.5..J'4;6 17.5 



2.5 



3.8 



5.6 
2.2 

74.7 65.2 66.3 
11.4 15.7 8.8 
11.4 11.2 21.3 



El Paso (N*100) 



Total APL 
(Nl 



JC 



52 48 



61.0 59.6 62.5 
39.0 40.4 37.5 



1.0 

92.0 
6.0 
1.0 

. 2.0 
1.0 



3.0 



9.2 
1.1 
100 

17.4 
1.4 
96 



1.9 - 

90.4 93.8 
7.7 4.2 
2.1 

- . 4.2 



1.9 

98 .-l. .95.8 

69^ 76V9 60.4 
28.0 'n\r^ 33.3 . 



6.3 



49.0 40.4 58.3 
51.0 59.6 41.7 



9.4 9.1 
1.0 1.2 
52 48 

17.5 17.3 

1.5 1.3 
50 46 



1.0 - 2.1 
92.0 90.4 93.8 
7.0 9.6 4.2 



Gary iN«796) 

Total NRP . ORP 
(N) (N) 



444 352 



77.5 
22.5 

.1 

81.9 
6.7 
8.4 
2.9 

6.9 
24.7 
15.5 
52.9 

89.1 
10.6 
^,4 

100 



9.6 
1.3 
796 

18.0 
1.^ 
796 



"7874- 
21.6 

.2 

89.4 

.'.7 
7.7 
4.1 

5.9 
24.1 
16.9 
53.2 

87 .*8 
11. S 
.7 



9.5 
1.3 
444 

18.0 
1.5 
444 



7674 
23.6 



83.8 

5.4 
^9.4^ 

1.4 

8.2 
25.6 
13.6 
52.6 

90.6*^: 



^00 100 



9.7 
1.3 

352 

18.1 
1.5 
352 



17.3 15.8 19.3 
5.2 6.3 3.7 
77.5 77.9 77.0 
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Table 16 (cont.) 



Sample Characteristics 
Selected Oemographfc Variables 



Characteristic 



Hale 

FcMle 

Ethnic Group: 

AMr. Ind. 

AsUn 

BUck 

HIsp. 

UDltt 

Other 
Sizt of Town: 

Under 2,500 

2,500-50.000 

50.000-250,000 

Over 250.000 
English Conp.: 

Good 

Filr/Poor 
None 

Resident U1 Hutu's 
Kts. 

Non^ res. 
Use Gride CompK: 

sd 

sd 
N 

Ung. Spoken: 
Amer.. Ind. 
Other 
Spanish 

Eng. 



Guthrie (N»176) I Pittsburgh (N*lll) 

JC 

Total API JC I Total Adklns WOW 
" " (N) j (N) (N) 



56.6 
43.4 



2.7 
4.4 

92.9 



58.7 
41.3 



48. 
51.2 



8 61 



/- 



1.1 / 2.4 
2.2- 4.8 
96. r 92.9 100 



.3 
38.7 



53.3 
<5.7 



66 



66.7 
33.3 



1.8 
.4 


4.3 










62.8 


64.1 


65.5 


39.6 


42.4 


3'. 9 


3.5 


2.2 


1.2 








29.6 


28.3 


29.8 


60.4 


57.8 


62.1 


1.8 


1.1 


3.6 








14.2 


14.1 


14.3 


21.6 


20.0 


22.7 


41.2 


37.0 


'40.5 


19.8 


15.6 


22.7 


17.7 


21.7 


14.3 


50.5 


60.0 


43.3 


27.0 


27.2 


31.0 


8.1 


4.4 


10.6 


96.9 


96.7 


97.6 


83.8 


88.9 


80.3 


3.1 


3.3 


2.4 


16.2. 


11.1 


19.7 


100 


100 


100 


66.7 


64.4 


68.2 








33.3 


35.6 


31.8 


9.7 


9.5 


9.8 


10.0 


10.2 


10.0 


1.9 


1.6 


1.4 


/1. 3 


1.4 


1.2 


.74 


91 


83 


110 


45 


65 


17.6 


17.5 


"•/ 


17.9 


18.1 


17.7 


1.4 


1.3 




1.6 


— H8— 




74 


9? 




110 


44 


66* 



100 



i.oenix (N«473) 



Total CAI 



4?6 [S2 16? 



NRP ORP 



56.0 
44.0 

9.3 
3.0 
16.1 
29.4 
41. S 
.6 

4.2 
8.5 
7.8 
79.5 

94.9 
2.5 
2.5 

50.7 
49.3 

9.9 
1.4 
460 

18.1 
1.5 
449 

<*.4 
3.4 
23.0 
69.1 



59.5 
40.5 

10.3 
0 

16.7 
31.7 
40.5 
.8 

6.3 
9.5 
6.3 
77.8 



55.5 
44.5 

8.8 
3.3 
18.7 
24.7 
43.4 



1.6 
7.1 
7.1 
84.1 



10.0 10.1 
1.3 1.4 
123 177 

18.1 17.9 
1.7 1.44 

123 167 



5.6 
.8 
25.4 
68.3 



2.7 
3.8 
18.1 
75.3 



53.9 
46.1 

9.1 
4.8 
12.7 
32.7 
40.6 



5.5 
9.1 
9.7 
75.8 



98.4 94.5 92.7 

1.6 3.3 2.4 

2.2 4.2 

4r 2 48.9 53.9 

50.8 51.1 46.1 



9.; 

.12 
160 

18.2 
1.C 
159 

5.5 
4.3 
26.7 
63.0 



Tongu i Point (H«167) 

Camb JC 

Total NRP ORP GEO GEO 
(N) jN) (N) {Ni. 



46.1 

53.9 

3.6 
v4.8 
31.7 
13.2 
40.7 

6.0 

13.8 
28.1 
14.4 
43.7 

93.4 
6.6 



100 



10.0 
1.1 
167 

18.0 
1.4 
167 



7.8 
4.2 
88.0 



68 



50 
50 

1.5 
4.4 
39.7 
16.2 
30.9 
7.4 

11.8 
23.5 
14.7 
50.0 

94.1 
5.9 



10.0 
1.1 
68 

18.1 
1.5 
68 



4.4 
7.4 
88.2 



15 



45.8 46.7 
54.2 53.3 



4.2 
6.9 
34.7 
11.1 
38.9 
4.2 

15.3 
30.6 
8.3 
45.8 

90.3 
9.7 



10.0 
1.2 
72 



9.7 
2.8 
87.5 



13.3 



13.3 
66.7 
6.7 

20.0 
26.7 
26.7 
26.7 



100 100 100 



10.1 
.8 
15 



18.0 17.9 
1.36 1.4 
72 15 



13.3 



12 



25 
75 



8.3 
8.3 
75.0 
8.3 

8.3 
41.7 

33.3 
16.7 



100 100 



100 



10.0 
.6 
12 

17.6 
1.1 
12 



8.3 



86.7 91.7 



Total 



Woodstock (N«153) ^ 
JC CAI JC 

Adklns WOW Hath Ntth 

iM (N) ^N) (NI 



90.8 
9.2 



98.0 
.7 
.7 
.7 

4.6 
15.0 

8.5 
71.9 

75.8 
24.2 



95.4 
4.6 

9.4 

1.3 
153 

17.8 
1.5 
151 



2.6 
.7 
96.7 



16 



93.8 
6.3 



100 



18.8. 

81.3 

56.3 
43.8 



93.8 
6.3 

9.6 
1.5 
16 

17.1 
.8 
16 



100 



20 



85.0 
15.0 



100 



20. 0 
10.0 
10.0 
60.0 

75.0 
25.0 



95.0 
5.0 

9.7 
1.3 
20 

17.9 
1.7 
19 



96.5 
3.5 



96.5 
1.8 

1.8 

1.8 
17.5 

5.3 
75.4 

82.5 
17.5 



98.2 
1.8 

9.3 
1.3 
57 

17.7 

. 1.5 
57 



100 



3.5 
1.8 
94.7 



86 
13.3 



98.3 
1 



3.3 
13.3 
13.3 
70.0 

75.0 
25.0 



93.3 
6.7 

9.4 

1.3 
60 

18.1 
1.6 
59 



3.3 
96.7 



ERJC 



18; 



\ 



SAMPLE CHARACTERISTICS 
TEST DATA 



ChiracterUtlcs 



fUSI 
J 
sd 
N 

HJSl 
X 

Sd 
N 

SAT Pre Rtad 
X 
sd 
N 

SAT 90 hr. Read 
X 

sd 
H 

SAT 150 hr. Read 
I 
sd 
N 

SAT Pre Math 
J 
sd 
N 

SAT 90 Hr. Hath 
J 
sd 
N 

SAT 150 hr. Math 
X 

sd 
N 

. out of school 
"50 



Breckinridge (N-631) 
Total NRP ORP STAFF 



1Q.1 
4.9 
604 

N/A 



3.5 
1.3 
549 

4.6 

2.0 
352 

4.8 

2.0 
85 



10.3 
60^ 



8.7 
4.0 
175 

N/A 



3.3 
1.2 
180 

4.5 

1.9 
115 

4.6 

2.2 
26 



12.0 
175 



10.2 
4.5 
194 

N/A 



3.8 
1.3 
194 

5.0 
2.0 
125 

5.2 
2.1 
24 



11. J 
189 



8.9 
4.5 
168 

N/A 



3.4 
1.3 
172 

4.3 
2.1 
110 

4.7 

1.9 
35 



10.0 
164 



Camb JC 
GEO GEO 



17.1 
3.9 
35 

N/A 



2 



6.3 
43 



16.1 
4J 
32 

N/A 



5.5 
38 



Clearfield (N*467) 
Total PLATO NRP 



ORP 



STAFF 



15.7 




13.5 


1 9 A 

1 £ . 1 


1 9 a 


1 5. 4 


1 5.9 


5.4 






4.0 


A Q 


4.4 


4.2 


357 




57 


63 


46 


inn 


52 


46.8 




39.4 


JO.O 




46.0 


45.6 


18.2 




1 1 . J 


1 Q Q 


ICQ 


1 7.4 


18.3 


396 




0 1 


7n 




95 


50 


5.8 


6.3 




0 . u 


1^ n 
9.U 


6.4 


6.6 


2.4 


2.2 


1 7 








2.0 


324 


44 


61 


71 


56 


99 


52 


6. 6 


6.9 


6.5 


5.1 


5.7 


6.9 


7.0 


2.5 


2.3 


2.2 


1.9 


2.3 


2.3 


2.3 


122 


25 


27 


19 


15 


33 


21 


I/O 


I/O 


I/O 


I/O 


I/O 


1/0 


I/O 


I/O 


I/O 


I/O 


I/O 


I/O 


I/O 


I/O 


I/O 


1/0 


I/O 


I/O 


I/O 


I/O 


I/O 


5.8 


6.8 








6.3 


6.2 


2.3 


1.1 








2.2 


2.1 


54 


10 








95 


52 


















I/O 


u 


u 


u 


6.4 


5.8 












2.3 


2.2 






"a. 

Q. 


"a. 
o. 


a. 

o. 




20 






< 


< 


< 








I/O 


O 




o 










c 




c 


I/O 


1/0 










f 








r 


z 








8.3 


9.3 


7.9 


11.5 


8.3 


3.9 


6.5 


411 


20C 

A 


69 


74 


68 


94 


48 



\ 



El Paso (NnoO) 
Total APL JC 



14.9 
4.6 
48 

46.5 

16.7 
45 

6.3 
2.6 
47 

6.7 
.7 

12 

I/O 
1/0 
I/O 

6.4 

2.4 
43 

7.8 
2.1 



1/0 



Gary {N-796) 
Total NRP 



3.3 
46 



10.8 
5.9 
795 

41.8 
17.0 
795 

4.9 

2.7 
607 

6.1 
3.0 
231 

6.0 
2.4 
34 



9.4 

661 



10.3 
5.7 
444 

41.9 
17.5 



4.7 

2.7 

360 

5.8 
2*8 
168 

6.1 
2.5 
30 



9.5 

360 



ORP 




1 



Table 17 {cont. ) 

SAMPLE CHARACTERISTICS 
TEST OATA 



Chdracteristic^ 



Guthrie (N'176) 
Total API JC 



RJSl 














X 


15.3 


14.4 


14.8 


17.5 


16 i 


17.9 


sd 


3.6 


3. 3 


3.6 


3.9 


J. 7 


4.0 


N 


167 


89 


78 


111 


45 


66 


MJSl 














T 


46.7 


43.8 


45.9 


55.4 


54.0 


56.4 


s<» 


16.0 


15.4 


14.2 


17.0 


16.1 


17.5 


N 


166 


88 


78 


110 


44 


66 


:;AT Pre Read 














X 


5.9 


5.4 


6.3 


7.1 


7.0 


7.2 


$d 


1.7 


1.5 


1.7 


26 


2.6 


2.6 


N 


106 


53 


53 


95 


40 


55 


SAT ^ hr. Read 














)( 








7 Q 


7.2 


8.6 


sd 


1,0 


I/O 




2.8 


2.7 


2.9 


N 








28 


16 


ir 


SAT 150 hr. Read 


* 












X 


I/O 


I/O 


I/O 


K/A 


N/A 


N/A 


sd 
N 


I/O 


l/D 


I/O 


N/A 


N/A 


N/A 


SAT £re Math 














X 


6.0 


5.4 


6.3 


6.6 


6.8 


6.5 


- sd 


1.9 


1.8 


1.8 


2.4 


2. '2 


2 6 


N 


103 


48 


55 


87 


• 43 


44 


SAT 90 hr. Math 














T 








7.0 


7.0 


7.1 


sd 


I/O 


I/O 


I/O 


2.6 


2.6 


2.7 


N 








29 


16 


13 


SAT 150 hr. MatJi 














X 


I/O 


I/O 


I/O 


N/A 


N/A 


N/A 


Sd 
N 


I/O 


I/O 


I/O 


N/A 


N/A 


N/A 


Mos. out of 














school P 




10.5 












7.9 




6.5 


5.7 


8.3 


N 


173 


84 




100 


37 


C3 



Pittsburgh (N-llD 
JC 

Total Adkins WOW 



Phoenix (N-473) 
Total CAI NRP OPP 



16.4 
5.4 
449 

40.5 
18.6 
441 

6.1 
2.6 
263 

7.5 
2.6 
79 

I/O 
.1/0 



4.8 
2.2 
268 

5.1 
2.1 
74 



I/O 
I/O 



11.7 
453 



17 
4.6 
120 

41.1 
19.0 
120 

6.6 
2.3 
82 

8.8 
1.8 
26 

I/O 
I/O 



5.0 
2.2 
81 

5.7 
1.7 
23 



I/O 
I/O 



11. />0 
121 



16.1 
5. 
174 

40.1 
17.9 
170 

6.0 
2 

98 

7.2 
2.5 
35 

I/O 
I/D 



4.8 
2.2 
98 

4.8 
2.0 
32 



I/O 
I/O 



10.1 
175 



15.8 
6.0 
155 

40. 
19. 
151 

5. 
2.7 
83 

6.0 
3.0 
18 

I/O 
I/O 



4 

2.1 
88 

5.0 
2.6 
19 



Tongue Point {N-167) 

Camb JC 
Total NRP ORP GEO GEO 



12.1 
157 



13.8 
4.9 
166 

N/A 
N7A 
N/A 

6.1 
2.1 
1:4 

6.9 
2.2 
70 

prog, 
term 



N/A 



10.6 
15J 



Woodstock {N' 153) 

JC CAI JC 
Total Adkins WOW Math Math 



IJ.4 


12.5 


21.5 


21.1 


12.7 


13.2 


17.2 


11.7 


12.0 


2.9 


4.4 


2.3 


2.9 


4.9 


2.9 


4.4 






68 


72 


14* 


12* 


151 


16 


19 


57 


59 


N/A 


N/A 


73.9 


71.6 


43.2 


41.9 


55.2 


39.6 


43.2 


N/A 


N/A 


9.7 


14.6 


15.5 


10.0 


15.6 


16.4 


U .0 


N/A 


N/A 


14 


12 


150 


16 . 


19 


55 


60 


0. u 


D. ^ 








A 7 


7 7 


U / A 

N/A 


... 
N/A 


1.6 


2.5 






2.9 


2.1 


2.9 


N/A 


N/A 


61 


62 






44 


15 


20 






7.1 


6.6 






5.1 


5.2 - 


5.1 


N/A 


N/A 


1.6 


2.5 






2.5 


2.1 


2.7 


N/A 


N/A 


33 


36 






26 


K 


16 


N/A 


N/A 


prog. 


proo 






prog. 


prog. 


prog. 


N/A 


N/A 


term 


term 






term 


term 


term 


N/A 


N/A 




























5.5 


5.3 


6.9 


5.1 


5.4 










2.1 


1.7 


2.1 


2.2 


2.i) 








a, 


t8 


16 


20 


55 


5; 








CL 












N/A 


N/A 


*J 


«f 

4J 


5.5 


6.2 


5.7 


5.2 


5.7 






0 
C 


c 


2.1 


1.7 


2.0 


2.4 


1.8 






M 


«/l 


100 


11 


18 


38 


33 






4-i 

</l 


4-1 
















«J 

h- 


« 


prog. 


prog. 


prog. 


prog. 


prog. 










term 


term 


tern 


term 


term 






< 
































11.6 


10.5 


9.0 


8.5 


6.8 


5.5 


4.2 


7.5 


9.8 


62 


(A 


15 


12 


139 


14 


20 


48 


57 
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6) At Pittsburgh, the Adkins program has more Corpsmnmbers 
from towns over 250,000 than the other program does. 

7) At Tongue Point, the ORP has more Corpsmembers from towns 
of 2,500-50,000 than the other programs do. 

8) At El Paso, the Corpsmembers in the Job Corps program have 
a higher level of English competence than the ones in the 
APL program. 

9) At El Paso, the Job Corps program has more residential 
Corpsmembers than the APL program does. 

The wide variance of population characteristics between sites suggests 
emphasis on an analytical approach which focuses upon seeking predictor 
variables for academic achievement by center rather than across centers. 

A basic question for experimental design is whether experimental 
and control groups are statistically equivalent. Because random- 
ization of subjects into groups was planned but assignment could not 
bo mandated, the researchers attempted to determine whether Corps- 
member samples for an experimental program and its traditional Job 
Corps program counterpart within a site were statistically equivalent. 
A series of 2 sample t tests were run to ascertain this. A two tailed 
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IS; 



test was employed so that significant differences that were either 
higher or lower, could be detected (Table 18). 

There is considerable variation in the significant relations among 
the treatment groups at the different centers. For example, at one 
center, in a particular program, females tend to have more schooling 
than males and in the "control" group no such relationship exsts; 
or males are more highly educated than females; or in one program 
within a center, American Indians have the lowest level of English 
Competence and in another program, they do not. 

The data indicate that the ethnic distribution by center and by 

Ok 

program vary considerably and that different centers and different 
programs within each center draw their population from different 
size towns. Size of the town is related to the CorpsmembeVs ' * 
English competency which may correlate to initial SAT level and to 
potential academic gain in reading and mathematics. 

All of the above pclnt to the conclusion that the randomization 
procedures have not produc^id a "pure" random distribution of the 
demographic and population variables that may be related to 
educational gain. Without statistical controls for demographic 
and population variance, some of the gains attributed to programs 
could be accounted for by demographic and population variances in 
the programs. 

<• 

169 



180 



Progr am 



Adkins 



API\ 



APL 



^^CA I -PLATO 



CAI/CMI 



Cambridge GEO 




Comp ari son 



Adkins vs Job Corps 
World of Work 



API vs Job Corps 
Reaolna and Math 



APL vs Job Corps 
Reading and Math 



PLATO Reading vs 
NRP 

PLATO Reading vs 
Job Corps Reading 

CAI Reading vs 
NRP 

CAI Reading vs 
Job Corps Reading 

Cambridge vs. Job 
Corps GEO 



TABLE 18 

Sta^stical Equivalence of Samples 



_SJ_te(s) 



Pittsburgh 



Woodstock 



Guthrie\ 



El Paso 



Clearfield** 



Phoenix** 



Breckinridge 
Tongue Point 



Test 


t 


df 


Siqni 


WSl 


-1.'8 


74 


NS 


MJSl 


.13 


74 


NS 


SAT Pre Reading 


.15 


70 


NS 


oAT Hre Math 


.56 


71 


N^ 


D IC 1 


-3.15 


33 


S 


nJbl 


-2.95 


33 


S 


SAT Pre Reading 


-3.11 


33 


s 


SM Pre Math 


-2.37 


34 


S 


D 1C1 

Hoot 


-1 .51 


62 


NS 


M 1C1 

nJb 1 


.06 


62 


NS 


SAT Pre Reading 


-1.64 


36 


NS 


SAT Pre liath 


- .58 


37 


NS 


D ICl 
nu J 1 


.80 

- .00 


95 
90 


NS 
NS 


SAT Pre Reading 


.51 


93 


NS 


SAT Pre Hath 


- . 


84 


KS 


RJSl 


3.08 


107 


S 


SAT Pre Reading 


1.86 


89 


NS 


RJSl 


4.42 


113 


S 


SAT Pre- Reading 


2.43 


110 


S 


RJSl 


2.72 


261 


S 


SAT Pre Reading 


2.08 


148 


S 


RJSl 


2.85 


246 


S 


SAT Pre Reading 


2.48 


136 


S 


RJSl 


l..'>9 


52 


NS 


RJSl 


.4t 


24 


NS 


MJSl 


.49 


24 


NS 




Program 



C omparison 



S1te(s) 



CAI Math 



HR? 



CAI Math vs. Job 
Corps Math 



NPP vs. Job Corps 
Readi ng 



Staffing 



NRP with aides 
vs NRP 



Woodstock 

Breckinridge 
Clearfield 
Gary 
Phoenix 
Tongue Point 

Breckinridge 

Clearfield 



Test 


t 


df 


Signl 


RJof 


- .39 


114 


NS 




-1.28 


113 


NS 


CAY 

SAT Pre Math 


- .79 


110 


NS 


nUJ 1 


-J. t/ 


369 


S 


SAT Pre Reading 


-4.34 


373 


s 


RJSl 


1.29 


118 


NS 


SAT Pre Reading 


.80 


123 


NS 


RJSl 


-2.87 


793 


S 


SAT Pre Reading 


-3.14 


640 


S 


RJSl 


.39 


279 


NS 


SAT Pre Reading 


.49 


149 


NS 


RJSl 


- .07 


121 


NS 


SAT Pre Reading 


- .02 


121 


NS 


RJSl 


- .56 


343 


NS 


JCRPl 


-1.03 


352 


NS 


SAT Pre Reading 


- .92 


147 


NS 


RJSl 


1.21 


101 


NS 


JCRPl 


.98 


85 


NS 


SAT Pre Reading 


.77. 


106 


NS 



Significance Is at least = .05 on a two-tailed, nondl recti onal test. 
** Significance expectod because non-computer reading programs contain enrollees below the 3.5 grade level and 
computer reading programs do not* 
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As can be seen from Table 18, entering samples are statistically equiva- 
lent at most sites in terms of entry test data. Difference other than 
those noted on the table are as expected and do not exceed the number 
expected by chance on this many tests. It should be noted, however, 
that demographic data show the sampled are in fact not equivalent. Enter- 
ing demographic data may be impacting on results, despite the initial 
equal ity^ 

2 

The analysis by program within site (see Tables 19-26) provides a 
picture of the significant relationships among the demographic and, popu- 
lation cjiaracteristics in Cohort 1- 

The data clearly -^'ndicate that some significant relationships occur across 
all of the sites and programs and some are either si\:e or progam specific, 
A brief conclusion regarding each finding is presented within the tables^. 

Cross-c^ter variations and relationships tend to be logical o^are a re- 
sult of redundancy. For example, there, is signif icai^u relationship be- 
tween Highest Grade Completed and Age, or that Hispanics speak Spanish- 
However, certain logical relationships do not always appear, such as 
those with "good" English competency have completed moy^e schooling. In 
at least one center, there is no significant relationship between 
English competency and the number of years of schooling completed, \ 
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Table 19 

Significant By Program Within Site 
Breckinridge Job Corps Center 



' Program 
New Reading Program (NRP) 
Job Corps Reading Program (ORP) 

Staffing 



Highest Grade Completed and Age 

English Competence and Highest Grade Completed 

Highest Grade Completed and Age 
Highest Grade Completed and Age 



Discussion 

The older enrol lees have completed more school 1 

Those with "good" English competency have 
completed more schooling. 

Self explanatory. 

Self explanatory. 
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/ 



Program 



(PLATO 



45h 



/ 



New Reading Program (NRP) / 



Table 20 

Significant By Program Within Site 
Clearfield Job Corps Center 



--£nQ^Ush-CcmpetenceHind--Age 

English Competence and Ethnic Group 

English Competence and Highest Grade Completed 

Ethnic Group and Language in Home 
Ethnic Group and Size of Town 
Highest Grade Completed and Sex 
Highest Grade Completed and Size of Town 

English Competence and Ethnic Group 



Size of Town and Ethnic Group 
Size of Town and Sex 



Discussion 

The American Indians have the lowest English 
competence. ^ 

The more education, the higher the English 
competence. 

Self explanatory. 

Blacks come from bigger towns. 

Males are more highly educated. 

Those with more education come from largeh towns. 

Anerican Indians have the lowest level of English 

rerSrden" '"'^''^ 
Blacks come from the biggest towns. 
Females are evenly distributed across all cdte- 
"^^^^ ""^'"'y f'^"^ towns over 
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£l2SI!§!2~ 



cn 



Adult Performance Level 
(APL) 



Job Corps Program 



J 

Table 2\ 

Significant By Program Within Site 
El Paso Job Corps Center 



Age and Ethnic Group 
Age and Language in Home 

Ethnic Group and Languaoe in Home 

Ethnic Group and Language in Home 



^prccussion ' 



The younger portion of the sample is Hispanic. 
The English speaking sample is older; Sfianish 

speaking sample is younger. 
Self explanatory. 

Self explanatory. 
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Program 
New Reading Program (NRP) 



Job Corps Reading Program (ORP) 



Table 22 

Significant By Program Within Site 
Gary Job Corps Center 



/ 



Age and Highest Grade Completed 
English Competence and Language in Home 



Ethnic Group and Lanouage in Home 
Ethnic Group and Size of Town 



Language in Home and Highest Grade Completed 

Language in Home and Sex 
Language in Home and Size of Town 



Agie and Highest Grade Completed 
English Competence and Ethnic Group 

Ethnic Group and Language in Home 
Ethnic Group and Size of Town 



Highest Grade Completed ond Language in Home 
Language in Home ana- Size of Town 



Discussion 

Self explanatory. 

English speaking enrol lees have the highest 
competence, then "other." then Spanish 
speaking. 

Self explanatory. 

The White sample is evenly distributed across 
categories, Hispanics are evenly distributed 
above the 2,500 category, and Blacks come from 
towns over 250,000 in the ratio of 2:1. 

Those in the "other" language category are the 
best educated. 

Spanish is spoken more in homes of females 

Spanish speakers are evenly distributed while 
English speakers and those in the "other" 
category come from big towns. 

Self explanatory. 

Hispanics have the lowest English competence. 

then Blacks, then Whites. 
Self explanatory. 

Whites are evenly distributed across all 

categories while Blacks and Hispanics come from 

the larger towns. 
English speaking enrol lees have completed more 

schooling. ' 
Spanish speaking enrollees are evenly distributed 

across all categories. 
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Program 

! 

Adkins World of Work 



Job Corps World of Work 



Table RO 

Significant By Program Within Site 
- Pittsburgh Job Corps Center 



Highest Grade Completed and Aqe 
Highest Grade Completed and Sex 
Highest Grade Completed and Sl2e of Town 

Residential Status and Sex 
Residential Status and Size of Town 

Sex and Age 

Ethnic Group and Size of Town 

Highest Grade Completed and Age 
Highest Grade Completed and Size of Town 

Residential Status and English Competence 

Residential Status and Sex 
Residential -Status and Size of Town 

Sex and Size of Town 

Size of Town and English Competence 

Size of Town and Ethnic Group 



Discussion 

Self explanatory. 

Female enrol lees have completed more schooling. 

Corpsmembers frofi: the larger towns have com- 
pleted more schooling. 

More females live off center. 

Enrollees from the larger towns tend to live 
off center. 

Female enrollees are older. 

Blacks seem to be coming from the larger towns 

Whites from the smaller. 
Self explanatory. 

Those with more schooling come from towns of 
2,500 or less. 

Those living on' center have lower English com- 
petency. 

More females live off center. 

I hose from the larger towns tend to live off 
center. 

Female enrollees tend to come from towns In the 

50.000-250,000 category. 
Those from the smaller towns have a lower level 

of English competence. 
The White sample does not come from the larger 

towns; It comes from the small and medium 

sized towns. 
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Table 2^ 

Significant X'^By Program Within Site 
Phoenix Job Corps Center 



P rogra^M 

Computer-Assisted Instruction 
(CAI) 



New Reading Program (NRP) 



Job Corps Reading Program (ORP) 



Ethnic Group and Size of Town 
Ethnic Group and Residential Status 
Ethnic Group and Language in Home 
Highest Grade ComDieted and Age 
Size of Town and Language in Home 

Age and Highest Grade Completed 
Age and Residential Status 

Ethnic Group and Size of Town 

Ethnic Group and Residential Status 

Highest Grade Completed and Size of Town, 

Langtiage in Home and Highest Grade Completed 



Ethnic Group and Residential Status 
Ethnic Group and Size of Town 

Ethnic Group and Age 



Ethnic Group and Highest Grade Completed 

Language in Home and English Competence 
Language in Home and Residential Status 

Highest Grade Completed and English Competence 



Discussi on 

Whites are from larger towns. 

There are more Whites living off center. 

Se^lf explanatory. 

Self explanatory. 

Spanish speakers come from the larger towns. 
Self explanatory. 

Youngest people live off center; oldest 

enro\lees live on center. 
All ethnic groups come from the larger towns and 

cities, predominantly :>50.000 and above. 
E'lacks and Hispanics tend more to live off the 

center. 

Corpsmembers coming from the larger towns have 

completed more schooling. 
English speaking corpsmembers have completed 

more grades in school than Spanish speaking 

corpsmembers. 

Blacks and Hispanics tend to live off center. 
Whites and Hispanics come from all size towns; 

Blacks come predominantly from the larger towns. 
Asians tend to represent the oldest population 

on center; Whites tend to be the youngest of 

the population. 
Whit-s tend to have completed more education in 

cotnparison to other groups. 
Asians have either no or poor English competency. 
Spanish speaking corpsmembers tend to live off 

center. 

If corpsmembers complete 7 grades, no relation- 
ship exists between highest grade completed 
and English Competency. 




Program 
New Reading Program (K9P) 

Job Corps Reading Program (ORP) 



Job Corps GEO 



Table 25 

Significant By Program Within Site 
Tongue Point Job Corps Center 



Ethnic Group and Size of Town 
Language in Home and Ethnic Group 

A<ie and Ethnic Group 

Age and English Competency 

English Competence and Ethnic Group 

English Competence and Sex 

Language in Home and English Competence 

Language in Home and Ethnic Gioup 
Sex.,and:Ethnic Group 

Size of Town and Ethnic Group 

Highest Grade Completed and Size of Town 

Language in Home and Ethnic '^Group 



Discussion 

Black corpsmembers come from the larger towns. 
Self explanatory. 

Asian enrollees are older. 
The older enrollees have lower English com- 
petency . 

Asians have lower English competency; the other 

ethnic groups are about the same. 
Females have higher English competency. 
Other' category is lowest; then Spanish speaking 

with English speaking the highest. 
Self explanatory. 

Except for the Blacks, all other ethnic groups 

have more fe.-nales in the sample. 
Black enrollees come from the larg^.r towns. . 

Enrollees from the larger towns have completed 

more schooling. 
Self explanatory. 
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Table 26 




Significant By Program Within 




Woodstock Job Corps Center 


Program 


xl 


CAI Math 


Age and Highest Grade Completed 


Job' Corps Math 


English Competency and Size of Town 



Discussion 

Self explanatory. 

The bigger the town, the better the English 
competency. 
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The Educational 



Program Intensity 



The intensity of these vaiiious..education nK).dels_.i.s_measured.Jn_.tei!ms_ 
of hours of treatment. Some models and some centers may schedule 
more hours of treatment in any given period. Corpsmembers drop out 
for a variety of reasons which may have nothing to do with the educa- 
tional program. All else being equal, models which are less intensive, 
will have higher dropout rates simply because they require more days 
of Job Corps participation to reach testing points. One criterion 
for the effectiveness of the models is their effect on attendance 
rates. All else being equal, better attendance will produce greater ' 
completion rates because youths attain these after a shorter period 
in Job Corps. 



For corpsmembers enrolled in most of the EIE programs (either ex- 
perimental or control)-, the completion of*90 in-subject hours re- 
presents a time frame of eighteen weeks. Coupled with an orientation 
program that encompasses one or two weeks, the 90 hours represents 
approximately five months of Job Corps enrollment. The time frame 
is the same whether the center operates using a split day education/ 
vocation program or one week of educational instruction alternated' 
With one week of vocational training. 

There are three notable exception to the foregoing. These are the - - 
Adkins. APL. and PLATO programs.' Cohort I of the Adkins program 
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operated on the basis of two class periods per day which compressed 
the course into nine weeks. This, combined with the orientation period, 
represents a Job Co rps enrollment of two and a half months. However, 
Cohort 2 will operate one class period per day extending the time in 
program co be comparable with others. 

The APL program is a complete program requiring four consecutive class 
periods per day. However, since this covers reading, mathematics and 
World of Work content, the 90 hour in-subject content takes approximately 
14 weeks for an enrollee to complete. This, combined with orientation 
time, means approximately four months of Job Corps enrollment, or about 
one month less than it would take to complete the same amount of content 
in the regular Job Corps program. 

The PLATO program also operates differently in that corpsmember scheduling 
is in two hour blocks of time. If total program is considered, it will 
take nine weeks to complete the 90 hours. Combined with the two week 
orientation, approximately three months of Job Corps enrollment is 
involved. However, insofar as the one period per day of computer time 
is concerned, the requisite time to complete 90 hours is eighteen weeks 
and the overall Job Corps enrollment time is five months making this 
comparable in time with other programs. 

Charts 6 and 7 and Table 27 show the time needed to attain 90 hours, 
modol absence rates, and class attendance by site. 

182 . ■ . 

• 210 



CHART 6 
JOB CORPS ENROLLMENT TIME 



Center 



Program 



Approximate Job Approximate Job 

Corps Enrollment Corps Enrollment 

Time To Reach Time To Reach 

30 Hrs. In Subjprt 90 Hrs. In Sub jprt 



Breckinridge Cambridge GEO 
Cambridge GEO 
NRP 
. NRP and 

Staffing Control 
Staffing 

Clearfield* NRP 

NRP 1 Staffing 
Control 
**PLATO 
Staffing 

EL Paso APL 

APL Control 

Gary nRP 

NRP Control 

Guthrie API 

API Control 

Pittsburgh Adkins 

Adkins Control 

Phoenix CAI 

CAI Control 

NRP- 

NRP Control 

Tongue Point Cambridge GEO 
Cambridge GEO 
Control 
NRP 

NRP Control 



4 wks. 
4 wks. 
7 wks. , 

7 wks. 

7 wks. 

8 wks. , 
8 wks. 

4 wks./8 wks, 
8 wks. 

6 wks. 

6 wks. 

7 wks. 
7 wks. 

7 wks. 
7 wks. 

4 wks. 
7 wks. 

7 wks. 
7 wks. 
7 wks. 
7 wks. 

'4 wks. 

4 wks. 
7 wks. 
7 wks. 



10 wks. 
10 wks. 
19 wks. 

19 wks. 

19 wks. 

20 wks. 
20 wks. 

10 wks./20 wks. 
20 wks. 

16 wks. 
16 wks. 

19 wks. 
19 wks. 

19 wks. 
19 wks. 

10 wks. 
19 wks. 

19 wks. 
19 wks. 
19 wks. 
19 wks. 

10 wks. 

10 wks. 
19 wks. 
19 wks. 
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CHART 6 (con't) 
JOB CORPS ENROLLMENT TIME 



-~ — Approxiraate Job 

Corps Enrollment ' 
Time To Reach 

Center Program 30 Hrs. In Subject 



Approximate Job 
Corps EnroTTmerif" 
Time to Reach 
90 Hrs. In SublecL 



Woodstock Adkins 4 wks. 10 wks, 

Adkins Control 7 wks* 19 wks, 

CAI Math 7 wks. 19 wks, 

CAI Math Control 7 wks. ^ 19 wks. 



\ 



'* If sole time on computer is counted, figures are 8 and 20 
' weeks respectively. If combined program is considered, 
the figures are 4 and 10 respectively. 

* Noted centers* time includes a two week rather than a one 
week orientation period. 
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Chart 7 

Percentage of Class Absence 
by Model 



Adklns Adklns API AP! 

Control ; Control 



APL 



API CAl CA! CAI 
Control Phoenix Phoenix PLATO 
Control 



CAI Cambridge Canbrid»» 
PLATO GEO 6ED 
Control Control 



NRP NRP Staffing Staffing 
Control Control 
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Table 27 



Percentage of Class Attendance 
By Program within Site 



Chirac: sri St 1c 



Total 
Sex: 

r FemU 

Ethnic Group:- 

American Indian: 

Asian 

Black 
^ Hispanic 

White 

Other 



Karyland 
CAI JC 
iteth Hath 



^. Adklns 



JC 



32.7 



31.7 
63.7 



33.1 
25.0 

15.0 



41.9 



41.4 
45.2 



42.6 
29.4 



32.4 



32.9 
25.0 



32.4 



52.0 



53.2 
40.0 



^2.0 



Phoenix 
NRP ORP 



CAI 



90.5 


89.9 


95.0 


90.5 


89.4 


95.1 


90.5 


90.7 


94.9 


94.8 


90.9 


95.2 


98.7 


99:6 




«8.9 


87.2 


95.4 


87.7 


89.4 


93.8 


89.6 


88.5 


95.7 


100.0 




97.9 



Pittsburgh 

Adkins WOW 
JC 



C*«aracter1$tic 


Breckinridge 








* 

Clearfield 






El Paso 


Gary 




Guthrie 




Camb. 
GEO ' 


JC 
GEO 


NRP 


ORP 


Staff 


PLATO 


Staff 


NRP 


ORP 


APL 


JC 


NRP 


ORP 


API 


JC 


Total 


89.0 


• 90.1 


85.9 


86.1 


82.9 


96.3 


95.5 


96.0 


96.4 


88.9 


90.1 


84.3 


88.2 


93.5 


91.1 


Sex: 
































Hale 

Female 


89.9 
84.9 


91.1 
86.9 


86.7 
81.8 


85.1 
89.8 


82.1 
86.2 


96.8 
95.3 


95.8 
94.4 


95.8 
96.7 


96.6 
95.4 


87.8 
90.1 


90.5 
89.3 


85.1 
81.1 


87.9 
89.2 


92.5 
96.3 


93.4 
88.1 


Ethnic Group: 

American Indian: 

Asian: 

Black: 

Hispanic: 

White: 
• Other: 

— 1 


88.9 
97.8 


90.2 
70.3 
91.0 


86.0 
80.5 
78.5 


86.1 
85.6 


88.1 
82.8 
92.8 




95.3 
64.6 
95.3 
97.6 
97.6 
33.3 


97.4 
100.0 
94.8 
97.0 
96.8 


97.9 
93.0 
96.0 
96.0 
96.1 
87.0 


95.6 
96.8 
95.8 
97.4 
• 97.8 
97.2 


88.3 

89.6 
77.4 


90.? 
65.1 
95.6 


51.3 

84.4 
90.1 
67.5 
87.2 


88.3 
88.2 
84.8 
90.2 


48.3 

94.9 
94.3 
91.4 
SO.O 


49.4 
84.7 
48.0 
92.6 
96.3 



Tongue Point P 
NRP ORP 



Camb. 
GEO 



JC 
GEO 



79.7 ' 


11.1 


85.9 


84.6 


98.9 


98.8 


77^5 


llA 


88.7 


87.4 


98.6 


100.0 


82.3 


73.9 


82.9 


81.6 


99.3 


98.2 








61.7 


100.0 






V- 


59.3 


95.2 






76.7 ^ 




86.8 


90.'* 


100.0 


100.0 






79.7 


69.6 


97.8 


100.0 


81.4 


IQ.l 


'86.4 


79.1 


98.7 


98.3 






97.1 


94.6 


100.0 


100.0 
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. Preliminary data indicates that the slightly varying amounts of time 
required for attainment of the 90 hour standard has not impacted 
significantly on> attendance 6r on terminations. Differential im- 
pacts may, however, be ascertained as the study continues and the 
sample size increases. 

The atl.ndance data presents some interesting preliminary findings. 
The only substantially significant total program difference is 
between the Adkins program and its control at Pittsburgh. Other 
significant differences are found in>various characteristics" and 

. attendance. For example, at Gary, attendance of whites in the ORP is 
significantly higher than in the NRP, but the reverse is true for 
blacks. At Phoenix, attendance in the CAI program is better than for 
the non^computer programs, although the same is not true for 
Clearfield. Attendance in GED programs at both Breckinridge and 
Tongue Point is better than for lower level programs supporting the 
contentions of previous Job Corps research. Attendance will 

continue to be tracked as the study progresses. 

Termination Data 

Questions as to whether certain types of enroll ees are more likely to 
drop out than are other types must be asked. Because entry character- 
istics differ from site to site, the question of early termination 
has to be asked on a center specific basis. As of the present time. 
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the sample size of most sites is not enough to enable statistically 
valid conclusions. As the study progresses, the 30 hour terminee 
will be characterized on the basis of demographic and entry test data 
and will be compared to both the 90 hour and the 150 hour completer. 

At the present time, certain terminee data are available relating to 
Job Corps Termination Category.. .This data may be found in Table 28. 
To date, the sample size is not large enough to enable analysis other 
than descriptive information as presented. 

An additional breakdown of the tertrii nations may be found by ethnic 
group. Table 29 presents the comparison, of the proportion of the EIE 
sample remaining active by ethnic group. The data presented 
represents that available as of February 14, 1980. 
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Chart 8 

PERCENTAGE OF EARLY TtRHINEES 
AT 30 !n-Program Hours 
by Model 




Adkins API API Cont. APL 
Cont. 



APL Cont. CA.- Phoenrx CAI-^^^ CAI-H^th CAI-Hath^^Ca.brldge Cambridge NRP NRP Cont. Staffing 
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< Chart 9 

PROGRAM EHROILEES vs. TERHIHATIOH 
BgrOflE 90 MRS. BY MDEL — ~ 



Enrol lees • | 1 

Termfnees by 90 hrs. « 




I^^K » API- 
Control 



APL Cent. CAI- CAI-PLATO CAI flath CAI Hath Cambridge Cambridge nRP 
Phoenix Control GEO ^ GED-Cont. 



NRP Cont. 

Staffing 
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Table 2H 

Terminations by Job Corps Category 
by Program within Site 





CENTER: 
HOOEL: 


Breckinridfje 
JC 

NRP REAO 


C^mb. 
GEO 


JC 
GEO 


Staffing 


Clearfield 
JC 

NRP REAO 


Staffing 


PLATO 


PLATO 
Control 


El 
APL 


Paso 

JC 

r idiii 


Gary 

MDD 

MKr 


JC 
REAO 


AOHIN. 




5.3 


9.5 


10.0 


8.0 


6.6 


0 


1.5 


6.8 


0 


0 


0 « 


n 
u 


7 7 


5.9 


AWOL 




4?. 4 


38.2 


30.0 


28.0 


40.5 


10.0 


12.5 


2.2 


16.6 


0 


0 


n 


18.8 


21.6 ' 


COMP. 




8.8 


7.8 


35.0 


28.0 


8.4 


18.0 


7.8 


4.5 


5.5 


0 


14.2 


25.0 






OISCIP. 




5.3 


2.6 


0 


8.0 


4.7 


2.0 


8.6 


22.7 


7.7 


,0 


0 


0 


15.7 


15.4 


MAX-BEN. 




2.6 


6.0 


0 


0 


1.8 


0 


.7 


0 


1.1 


0 


0 


0 


0 


0 


MEOICAL DEATH 




2.6 


1.7 


0 


0 


9 


0 


1.5 


0 


0 


0 


0 


0 


1.5 


1.7 


RESIG. 




30.9 


33.9 


25.0 


24,0 


35.8 70.0 


64.5 


63.6 


65.5 


66.6 


85.7 


75.0 


48.1 


52.3 


TRANS. 




,8 


.0 


.0 


4.0 


.9 


0 


2.3 


.0 


2.2 


33.3 


0 


0 


.3 


.0 


TRANSFER TO ACT 




.8 


.0 


.0 


.0 


.0 


0 


0 


.0 


1.1 


.0 


0 


0 


.0 


.0 





CENTER: Guthrie 


Maryland 








Pittsburgh 


Phoeni 


X 




Tongue Point 








MOOEL: API 


JC 
Program 


Classmate 88 


JC 

Math 


Adkins 


. JC 
WOW 


Adkins 


JC 

wow 


NRP 


JC 

READ 


CAI 

REAO/Math 


NRP 


JC 


Camb. 


JC 


ADHIN. 


0 


0 


6.2 


0 


.0 


0 


5.0 


3.5 


1.6 


3.7 


0 


0 


READ 
0 


GEO 
0 


GEO 
0 


AWOL 


47.0 


58.3 


68.7 


54.5 


40.0 


0 


10.0 


14.2 


43.3 


49.0 


48.0 


25.0 


43.4 


0 


0 


COHP. 


0 


. 8.3 


0 


0 


0 


0 


10.0 


0 


5.0 


11.3 


24.0 


U 


0 


0 


0 


DISCIP.- 


0 


0 


6.2 


0 


60.0 


0 


0 


10.7 


5.0 


1.8 


4.0 


0 


4.3 


0 


0 


MAX -BEN. 


5.8 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 
0 


MEOICAL OEATH 


0 


8.3 


0 


4.5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


RESIG. 


47.0 




in.7 


36.3 


0 


100 


71.0 


67.8 


45.0 


33.9 


24.0 


75.0 


52.1 


100 


100 


TRANS. 


0 


0 


0 


4.5 


0 


0 


0 


3.5 


0 


0 


0 


0 


0 


0 


0 


TRANSFER TO ACT 


0 


0 


.0 


' 0 


0 


0 


0 


0 


0* 


0 


0 


0 


0 


0 


0 
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Table 29 



Percentage of Enrollees Remaining Active 
by Ethnic Group 

N = 3955 



Ethnic Group 


Total 
Sample 


Experimental 
Sample 


Control 
Sample 


American Indian 


66.7 


68.3 


63.6 


Asian 


61.8 


5'3.-8 


66.7 


Black 


^ 45.6 


49.7 


40.8 


Hispanic 


58.8 


57.3 


60.6 


White 


51.3 


57.7 


43.3 


Other 


°39.1 


38.2 


40.0 



1> 



These figure^ can be compared to an overall ^'igure of approximately 49 
.percent of enrollees remaining active in the total EIE study. It js. 
evident from the above figures that the experimental programs are 
making an impact on the retention of both Black and White enrollees. 
the two largest ethnic groups in the sample. • Sample sizes from the 
other ethnic groups are still too small on which to base definitive 
conclusions. 



An additional question relating to characteristics of those completing 
segments of the program as compared to characteristics of those 
terminating early must be asked. Data comparing the 90 hour completer 
and the early terminee in reading programs may be found in Table 30 
and similar data for math program enrollees is contained in Table 31. 
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Table 30 

90 Hour Completers Vs. Progr«m Terminees 
in Reading Prograi^is on Selected Chartcterfstfcs 



Charicteristic 



Sex: 
Kale 
Female 

Ethnic Group: 

Amer. Ind. 

Asian 

(lack 

Hispanic 

White 

Other 
Residential Status: 

Res 

Non Res 
English Competency: ^ 
' Good 

Tafr/Poor 

None 
Age: 

N 

Nean 

Std. Dev. 

Ust Sridt Coiipltted: 

N ^ 

NHn 
, Std Dtv. 
RJSI: 

N. 

NNn * 
Std. Dev. 
toadln^ Attest: 
N 

I NNn 
Std. Otv. 



Total Sample 



yo Hr. Compf 



(N«714) 



74.4 
25.6 



.5 
1.0 
78.6 
8.9 
8.5 
2.2 

97.8 
2.2 

86.8 
13.0 
.1 

772 
18.3 
1.58 

774 
9.8 
1.36 

747 
11.33 
5.42 

774 
4.83 

2.50 



Terminees 



(N«758) 



75.3 
24.5 



' 1.1 
.3 
74.0 
7.9 
15.6 
1.2 

94.5 
5.5 

69.2 
10.7 
.1 

755 
16.0 
1.52 

758 
9.7 
1.30 

745 

11.69 
5.58 

758 
5.13 
2.52 



Experimental Sample 



»0 Hr. Coiipl 



(?««511) 



77.3 
22.7 



.6 
.4 

79.3 
9.2 
7.6 
2.7 

97.7 
2.3 

88.6 
11.4 



510 
16.3 
1.57 

511 
9.7 
1.34 

491 
11.04 
5.34 

511 
4.65 
2.33 



Temlnees 



(NM08) 



76.7 
23.3 



1.0 
.2 
73.3 

6.3 
15.7 

1.5 

93.9 
6.1 

68.2 
11.3 
.5 

406 

17.9 
1.51 

408 
9.7 
1.34 

404 

11.28 
5.53 

408 
4.81 

2.55 



Control Sample 



90 Hr. CompV 



(N-263) 



63.8 
31.2 



2.3 
77.9 
8.4 

10.3 
1.1 

96.1 
1.9 

63.3 
16.3 
.4 

262 
16.4 
1.61 

263 
9.9 
1.39 

256 
11.69 
5.53 

263 
5.19 
2.76 



Tennlnees 



(N»350) 



74.0 
26.0 



1.1 
.3 
74.9 

7.4 
15.4 



95.1 
4.9 

90.0 
10.0 



349 
18.1 
1.52 

350 
9.7 
1.25 

341 

12.17 
5.61 

350 \ 
5.52 
2.53 
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Table 31 

90 Hour Completers Vs, Program Terminees 
In Math Programs on Selected Characteristics 



Characteristic 


Total 


Sample 


Experimental Sample 


Control Sample 


90 Hr. Compl. 
(N«156) 


Tenninees 
(N«193) 


90 Hr . Compl . 
(N-081 ) 


^ Terminees 






Sex: 














Male 


80.1 


74.1 „ 


81.5 


78.7 


78.7 


69.7 


F-etnale 


19.9 


25.9 


18.5- 


21'. 3 


^ 21.3 


30.3 


Ethnic Group- 














Amer. Ind. 


_ 


1.6 


- 


1.1 




2.0 


Asjan 


.6 


i;o 


1.2 


1.1 


- 


1.0 


Black 


70.5 


48.7 


65.4 


43.6 


76.0 


53.5 


Hispanic 


16.7 


24.0 


23.5 


19.1 


9.3 


11.1 


White 


11.5 


33.1 ' 


8.6 


34.0 


l'4.7 


32.3 


« Other 


.6 


.5 


1 .2 


1.1 


- 


- 


^Residential Status: 










- 




Res^ 


86.5 


77.2 


82.7 


74.3 


90.7 


79.8 


Hon Res 


13.5 


22.0 


17.3 


25.5 


9.3 


20.2 


English Compentency: 














Good 


78.2 


85.5 


82.7 


83.0 


73.3 


87.9 


Fair/Poor 


21.2 


14.0 


17.3 


17>0 • 


25.3 


11.1 


None 


.6 y 


.5 


- 


- 


1.3 


1.0 


Age: 














N 


154 


191 


80 


92 


74 


99 


Mean 


17.8 


17.8 


17.7 


17.6 


17.8 


18.0 


Std. Dev. 


1.59 


1.80 


1.62 


1.89 


1.57 ^ 


1.70 


Last Grade Completed: 














N 


156 


1 93 


81 


94 


75 


99 


Mean 


9.4 


10.0 


9.3 . 


10.0 


9.4 


10.0 


Std. Dev. 


1.39 


1.37 


1.30 


1.35 


1.49 


1.37 


RJSI : 














N 


150 


181 


80 


91 


70 


90 


Mtan 


13.68 


15.28 


13.06 


15.24 


14.39 


15.3'i 


Std. Oev. 


5.14 


5.22 


4.60 


5.29 


5.66 


5.18 


NJSI: 














n 


153 


185 . 


79 


90 


74 


95. 


Mean 


44.92 


43.90 


40.62 


43.32 


49.50 


44.44 


Std. Dev. 


16.88 


19.86 


16.04 


20.66 


16.64 


19.17 


Kith Pretest: 














N 


156 


193 


81 


94 


75 


^99 


Mtan 


5.75 


5.68 


5.42 


5.75 


6.12 


5.62 


- Std. Dtv. 


2.10 ' 


2.43 


2.05 


2.49 


2.11 


2.38 
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Math program data show more in the way of differences than did 
reading program data; however, the sample size is much smaller. 
More fem ales, proportionately, are terminating from math programs 
than are completing 90 hours; the same is not true for males. Tha 
nonresidential enrollees are terminating at a significantly hig her 
rate tha n are residential enrollees; English competency for total 
sample an d- Job Corps math program terminees is significantly higher 
than for 90 hour completers. RJSI scores for terminees are higher 
than for 90 hour completers across all c ate gories although MJSI and 
SAT Mathlematics Com putations results are not consistent across all 
programs. 

Educational Gains 

Educational gains data reported are based on grade level conversion 
.of raw scores on the Stanford Achievement Tests. When broken down 
by program within site, gains data are based on very small sample 
sizes. This is due, at least in part, to the problems related to 
posttesting terminating Corpsmembers. The "expected gains" data 
are based on converting 90 hours to 4 1/2 months in Job Corps and 
150 hours to 71/2 months in Job Corps based on one class hour per ' 
day. Expected. gains are then comparable to the SAT grade level 
conversion of 1.0 academic years per 10 month school year. Table 
32 contains by program/within site available gains data. 
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TABLE 32 

SAT Reading and Math Educational Gains Data 
. by Program 



Model 



Reading Test Data 



90 Ho ur 
Sain 



N 



150 Hour 



Math Test Data 



Gain N 



90 Hour 



Gain 



M 



150 Hour 



Gain 



APL 

|(PL Control 

CAI - Phoenix 

CAl - Phoenix Control 

CAI - PLATO 

CAI - PLATO Control 

NRP 

NRP Control 

Staffing 

Staffing Control 

Over- 
Experimental 

Overall Control 



1.6 
1.6 
2.4 
1.8 
1.8 
1.4 
1.6 
1.5 
1.3 
1.5 

1.6 
1.5 



10 
8 
24 
16 
16 
14 
309 
219 
88 
106 

447 
363 



1.8 6 
Insufficient Data 
Insufficient Data 
Insufficient Data. 
Insufficient Data 
.Insufficient Data 
2.2 48 
1.7 22 
1.5 31 
1.7 22 



1.9 
1.7 



85 
48 



1.3 13 

Insufficient Data 
1.3 19 
.7 13 
Insufficient Data 
Insufficient Data 
Not applicable 
<Wot applicable 
Not applicable 
Not applicable 



1.3 
.7 



32 
13 



ra 
Q 

-M 
C 
Q) 

(/) 
C 



* Model not ci 



ted have insufficient data at this time. 
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The average gains in both reading and math as measured by the SAT 
demonstrate that enrollees in all Job Corps programs (experimental 
and control) are achieving above the expected rates for students in 
a school setting. However, also interesting to note is the fact that 
preliminary 150 hour test data show a slippage in amount of gain 
over time. Data illustrate that the. proportion of gain in 150 hours 
is not significantly different from that in 90 hours. Students still 
Isarn, but at a slower rate, as time in Job Corps increases. This 
is consistent with previous findings related to education in Job 
Corps (see, for example, Levitan, 1975). 

Although the data from a number of programs is still missing due to 
the fact that enough of the Corpsmembers have not as yet completed 
90 hours of training, the preliminary results are encouraging as to 
the effect iveness of the Job Corps prog rams. 

In an earlier study of educational gains in Job Corps reported by 
Levitan .(1975), the average gains per man month of training in 
reading comprehension ranged from a low of 1.3 to 2.1 months according 
to different measures. Converted into gains in aca^demic achieve- 
ment in (10 months) school years, the range would be from 1.56 years 
to 2.64 school, years of achievement for a youth in Job Corp. On 
the basis of 90 hours of training, present data show that the 
absolute gain in reading comprehension achievement ranges from 
mean score low of 1.3 years in the Brec' .nridge Staffing Program 
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to a high of 2.43 in the CAI program at Phoenix. 

In regards to improvement in reading achievement, it can be seen that > 
on the basis of only 90 hours of instruction, it is already comparable 
to the improvement produced by the Job Corps programs in the period 
from 1968 through 1972 for those completing the entire training 
program. We can, therefore, at this time, predict that reading 
comprehension gains by the time the Corpsmembers who complete the 
programs will exceed the 1968 through 1972 norms . 

Levi tan (1975) also reports monthly gains at Job Corps Centers from 
1968 to 1974, for Arithmetic Computation. Converted into gains in 
academic achievement in years, the range is from a low of 1.56 years 
to a high of 3.0 years. At this time there are sufficient data to 
compare the current programs with the effectiveness of the Job Corps 
Programs from 1968-1972 in helping to improve the Corpsmembers* 
arithmetic computation. As soon as enough Corpsmembers have com- 
pleted 90 hours and 150 hours of training, a meaningful comparison 
will be made. In addition, the effectiveness of the various 
programs and the effectiveness of each of the programs within the 
climate of each center will be compared. 

In order to determine whether there was a significant difference in 
90 hour gain between selecte' experimental programs and their control 
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programs, a series of Analysis of Variance (ANOVA) tests were run. 
The ANOVA procedure i5 used to determine whether or not there is a 
significant difference between group means for two or more groups. 
TabU- 33 presents this data. The degrees of freedom are based on the 
number of groups (first figure) and the N in each group (second figure). 



Table 33 

Significance Test on Reading Gains 
At Selected Sites 



Comparison 


Site 


F 


Degrees of 
Freedom 


Significance 
Level ' 


CAI 

vs. Job Corps 


Phoenix 


1.501 


1 and 38 


NS 


NRP 

vs . .Job Corps 


Breckinridge 


.413 


1 and 198 


NS 




Clearfield 


1.551 


1 and 26 


NS 




Gary 


.284 


1 and 197 


NS 




Phoenix 


.28 


1 and 46 


NS 




Tongue Point 


.080 


1 and 51 


NS 


PLATO 
vs. Job Corps 


Clearfield 


.651 


1 and 28 


NS 


Staffing 
vs. Job Corps 


Breckinridge 


1.756 


1 and 192 


NS 



I 
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As can be seen from Table 33, comparative gains data between programs 
has not reached statistical significance at the 5 percent level. There 
.are several possible reasons for this. In the first place, teachers 
are not as familiar with the experimantal programs as they are with 
the traditional Job Corps educational programs and this could be 
impacting on Corpsmember gains. Second cohort data will contain 

valuable information jji.-expJMQijig_ this possJMl^^ i n- 

creased sample sizes will enable the determination of whether differ- 
ences are really significant. The small size used in these tests 
would necessitate a very big difference in order to attain significance. 

' Step-wise multiple regression programs were run on approximately - 
3,000 EIE enrollees. The first step-wise regression analysis employed 
overall reading gain at 90 hours as the outcome variable. The predictor 
variables were ethnic group, sex, pre SAT math score, pre SAT reading 
score, model, number of hours in model, age, highest grade completed 
and English competency. Only 4 percent of the variance in reading 
gains could be accounted for by these predictor variables. This 4 
percent of variance does, not, however, represent a true estimate of the 
predicting power of the independent variables. This is due to the 
mul tied linearity of the data and possible statistical violations of 
some of the assumptions of regression analysis, particularly that all 
groups have the same variance. 
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. A step-wise multiple regression was also performed employing the most 
significant results which occurred on the basis of the multiple regres- 
sion analysis of average math score gains at 150 hours. The predictor 
variables accounted for ^6 percent of the variance. The variance 
change accounted for by pre SAT reading was 31 percent. This indicates 
the existence of a strong relationship between the cognitive and 

..ii°^^^^tio"l''_lbilities_t^ in .reading ability^as- measured by - - 

the SAT; These appear to be very much the same as the abilities 
accounting for average gain in math per instructional hour in an 
extended educational program. 

Other step-wise multiple regressions were run in order to ascertain 
other differential-predic-tifig -power of the independent variables 
employed. The analysis employing reading gain at 150 hours as the 
dependent variable showed that the predictor variables accounted for 
24 percent.of the variance. The strongest predictor in this instance ' 
was pre SAT math which accounted for 17 percent of the variance. 

The regression analysis performed employing gain in math at 90 hours 
duplicated the results of that for 90 hour gain in reading. Only 
10 percent of the variance could.be accounted for by the predictor 
variables. Again, this result appears to be an artifact of the 
statistical nature of the data. 
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GEO Data 



There are three experimental programs in EIE that are designed for 
use with students at the GED level,. The American Preparatory Institute 
(API) program being tested at Guthrie has a GED component as does the 
PLATO Computer-Assisted Instruction program at Clearfield. In addition, 
the Cambridge GED program was tested at Tongue Point and is being tested 
at Breckinridge. There are limited data on the GED programs both because 
they have not been in operation long enough and because sample sizes are 
small. Available results on the GED Practice Test (used as pretest measure) 
and on State GED Exams are contained in Table 34. Linear regression 
coefficients and Pearson correlations using Practice Test results as a 
predictor of State GED exam scores for each of the five GED subtests 
are contained in Charts 10 to ;14. The obtained correlations for the 
small sample data presented here are quite high on four of the five 
subtests. As tlje study progresses, an attempt will be made to ascertain 
requisite time necessary In each content area for certain pretest scores 
before successful passing of the State GED exam. 

It should be noted that available data indicate a passing percentage 
on the State GED exam of almost 97 percent. However, there is 
currently no way of knowing whether test results are first time results 
or retakes. 
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TABLE 34 ' 

GEO TEST RESULTS 
By PRCKRAM WITHIN CENTER 



C«br1d9€ 



Job Corps 



HATO 



Guthrie 
Breckinridge 

Tongut Point 

Guthrit 

Breckinridge 

Tongue Point 
Clearfield 



Test 



English 

N«th 

fteiding 

Science 

Soc. Studies 

English 

Math 

Reading 

Science 

Soc. Studies 



English 

Math 

Reading 

Science 

Soc. Studies 

English 

Math 

Reading 

Science 

Soc. Studies 

English 
Math 
Reading 
Science 
Soc. Studies 



Practice test 
?1ean Std. Dev. 



43.4 
45,3 
47.5 
45.9 
42.3 
46.8 
46.6 
49.6 
51.8 
48.7 



45.0 
43.4 
47.7 
48.3 
46.8 
45.6 
51.9 
54.2 
50.5 
50.2 

42.4 
41.9 
45.7 
46.3 
44.9 



4.8 
4.4 
4.8 

5.9 
6.8 
6.3 
5.8 
7.1 
5.5 
4.6 



6.4 
2.1 
4.2 
4.4 
4.5 
4.9 
6.7 
4.6 
3.7 
4.7 

3.1 
4.4 
5.4 
4.2 

5.2 



State Exan 
Mean Std. 



Dev. 



Data not yet available 



33 
26 
27 
23 
35 
13 
13 
14 
13 
14 



45.1 
46.3 
49.1 
48.7 
46.7 



4.4 

5.6 
5.6 
4.4 
5.3 



Insufficient Data 



Data not yet available 




5.6 
5.5 
'5.0 
4.4 

3.5v 



Insufficient Data 



5.9 
5.5 
417 
5.5 
5.4 



29 
29 
30 
34 
34 



28 
22 
23 
25 
^21 



18 
18 
18 
18 
18 
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Chart 10 
Linear Regression OUgram 

for Predicting GEO State Exam 

Score In English from GEO Practice Test 

Score In English 

N«23 




Practice Test Score 



CORRELATION = 0.525081351028 
Y-INTERCEPT = 38.3940575749 
SLOPE = 0 354842236025 



45 



50 



55 



60 



Chart n 
Linear Regression Diagram 
for Predicting GEO State Exam 
Score In Math from GEO Practice Test 



Score In Hath 




CORRELATION = 0.434591221262 
Y-INTERCEPT = 37.4296572191 
SLOPE = 0.357269352719 



L_t I I 

45 50 55 " 60 



30 _ 



25 I , , , 

. 25 30 35 40 

Practice Test Score 



23S 



239 



24U 



er|c 



o 
cr» 



60 



55 



50 



45 



40 



s 

5 35 



30 



25 
25 



c 

o 



Chart 12 " 
Linear Regression Diagram 
for Predicting State GEO Exam 
Score Jn Reading from GEO Practice Test 
In Reading 

N«24 




CORRELATION = 0.36770036885 
Y-^NTERCEPT = 38.3343612938 
SLOPE = 0.345189144737 



30 -5 

Practice T?$t v,ore 



40 



45 



50 



55 



60 
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Chart 13 
Linear Regression Diagram 

for Predicting State 6ED Exam Score 



In Science from 6ED P^ractlce Test In 



Science 




Chart 14 

60 r- Lfnear Regression Diagram 

for Predicting State GEO txam Score 
in Social Studies from GED Practice Test in 

• _ 

Social Studies ^ H 
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Adkins Test Data 



in order to measure the competencies taught by the Adkins program, the 
researchers developed pre and posttests from the items contained in 
the Occupational Knowledge, Consumer Economics,, and Community Resources 
Adult Performance Level (APL) tests. The pre and post measures were 
devised from data obtained on the APL test from a sample of Job Corps 
enrol lees. Item difficulty and discrimination indices were calculated, 
items were matched on the basis of requisite skills, and parallel tests 
were constructed and validated on a Job Corps sample. 

The Adkins program was implemented at two sites— Pittsburgh and 
Woodstock. Woodstock data is being presented here; however, it should 
be interpreted in light of the numerous site difficulties encountered. 
Additionally, the program at Woodstock was not continued for Phase 2 of 
EIE.' All Corpsmembers were posttested before program suspension; 
however, results are not indicative of the completion of either the 
Adkins or the Job Corps World of Work progr?nis. 

Table 35 contains pretest and posttest data by -program by site in 
terms of means and mean changes for both total score test results and 
performance on each of .the three major instrument objectives. It 
should be noted that the test used for these programs was constructed 
as a competency-based test and information treating it as such may be 
found in Table 36. 
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TABLE 35 
mm mr kesuits 

By Mtl and SUt 



ToUl Scort Ktsults 





API Prttest Hean 


API Posttest Hel'n 


Hean Gain 


Pittsburgh Exp«r<»ftnU1 


28.37 


34.00 


5.63 , 


Pittsburgh Control 


So. 61 


35.69 


5.08 


Ntryland ExpcrlMnt«1 


19.50 


22.08 


2.58 


Maryland Control 


29.33 


26.06 


-3.27 



Compontnt ItM Category Results 



Occupat ion al Knowledqe-13 Itey Consui»tr Econojilcs-22 Items Coawunlty Resources-17 Itews 

Pretest '<ean Posttest nttn Htan 6aln Pretest H<Mn P ostttst Hean Mean Gain Pretest Mean KisttestMeiiT Mean Gain 



fIttsNirgh Exptrloental 
Httibwrgi) Control 
ftoryland Expcrlmtntal 
Mirylind Control 



8.25 


9.50 


1.25 


12.86 


14.43 


1.57 


7.25 


9.93 


2.68 


8.76 


10.00 


1.24 


13.08 


T5.69 


2.61 


9.46 


10.14 


.68 


5.50 


7.66 


. 2.16 


9.75 


9.16 


-.59 


4.41 


4.16 


. -.25 


7.33 


6.27 


•1.06 


14.05 


11.11 


-2.94 


9.11 


9.22 


,11 



TABLE 36 

Adkins Test ' 
Mastery Data By Trogram Within Site 



Site 


Group 


N 


Test 


Occupational Knowledqe 
(13 items) 


Consumer Economics 
(22 Items) 


Communi ty Resources 
(17 Items) 


' Pittsburgh 


Adkins 


16 


Pre 
Post 


19X 
44X 


IX 
19X 


OX 
31 X 




JC 


13 


Pre 

Post . 


38X 
383; 


8X 
46X 


OX 
31X 


VIoodstock 


Adkins 


12 


Pre 
Post 


OX 
17X 


IX 
OX 


OX 
OX 




JC 




Pre 
Post 


2X 
6X 


4X 
22X 


OX 
17X 



24S 
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The standard employed for the determination of mastery was an arbitrary 
one of 80 percent. While seemingly "arbitrary," this standard was 
thoughtfully conceived. The 80 percent mastery standard is the one' 
most commonly used in both research and practice. Additionally, a 
comparative study of several methods for determining the cut-score on 
a competency-based test (Malech, 1978) yielded results showing that 
this methodology results in a passing percentage on each objective 
roughly in the middle of those established by more sophisticated 
statistical procedures. This method is not data dependent for the 
establishment of model parameters and therefore, is not affected by 
site differences. The proportion of misclassifications from this 
procedure does not deviate enough from the more sophisticated models 
to warrant the computational complexity necessitated by probability or 
Bayesian approaches. Additionally, many of the more sophisticated 
procedures are not designed to be used with objectives containing this 
large a number of items. 

The competency- based data which are presented here should be inter- 
preted wi^th caution for several reasons. First, the test Itself may 
not be measuring the competencies taught within either the Adkins or 
the Job Corps World of Work programs. Second, the competency weighting 
within the test, in terms of number of items, does not appear to be 
consistent with the curriculum emphases of the relevant programs. 
. Third, students in these programs are required to take the Adkins test 
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and the SAT tests which were included to measure any transfer of motiva- 
tional learning effects. 

Preliminary information indicates that the students resent taking so 
many posttests amd are, therefore, not really trying. This, in and of • 
itself, negates the validity of the use of this test to measure program 
effectiveness. Fourth, site conditions and/or program conditions may 
be affecting results. Teachers who were trained in the use of the 
Adkins program left Job Corps and untrained teachers took their place; 
financial considerations resulted in Pittsburgh being provided with 
only seven of the ten Adkins units making the program shorter than 
90 hours; and suspension of the study at Woodstock necessitated post- 
testing before the completion of the course. 

2 • 

The researchers are investigating the possible use of other instru- 
mentation by which to evaluate the Adkins and Job Corps World of Work 
programs. In addition, it is strongly recommended that the Adkins 
program be tested at a larger site in-order to obtain a sufficient 
sample size to enable accurate determination of the potential value 
of the Adkins program for more wide scale use in Job Corps. 
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. Process Evaluation Data 

""In'additfon to the impact of experimental programs in terms of 
retention rate, attendance, gains, etc., there are certain operational 
questions which must be asked. These relate to program satisfaction on 
the part of both Corpsmembers and teachers, as well as to such things 
as ease of implementation and cost. The primary emphasis in this pre- 
liminary study will be on Corpsmember satisfaction. 

Corpsmember satisfaction questionnaires were developed utilizing a 
series of core questions which would be asked of all eirollees and a 
series of questions based on specific models. The ques'ionnaires 
were set up on a 5 point Likert scale with 3.0 being the neutral 
point. Thus, the scores above 3.0 demonstrate a positive attitude. 
Item means for the core questions by model are presented in Table 37. 

. .It can be seen from ^his data, that all Job Corps enrollees in this 
sample have a highly positive attitude toward both Job Corps and 
education in general. Some of the sample sizes are small, but the 
results contained herein are consistent with previous Job Corps data 
gathered by the researchers. Therefore, it, is believed that the 
positive attitude will be maintained as the sample size increases. 

Additionally, while there is fluctuation among models regarding 
response to the same question, this is as was expected. Different 
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TABLE 37 

Corpsmcffiber Satisfaction Data By Hodel And Center 
Core Questions 



Qutitlons 


NRP 
Brecklnrldoe 


Job Corps 
Read. Program 

Brecklnrldqe 


Staffinr 
Breckinridge 


CAI 
PLATO 
Clearfield 


NRP 
Clearfield 


Job Corps 
Read. Program 
Clearfield 


Staffing 
Clearfield 


1 1*jm tK4noc au4rl(1v 


3 74 

(27) 


3 71 
(21) 


J. 

(15) 


J. oc 
(75) 


J. fO 

(28) 


J. bo 
(23) 


3.42 
; (19) 


I enjoy learning 


4.18 

(27) 


4.38 
(21) 


4.46 

(15) 


3.93 
(7i) 


. 3.78 
(28) 


4.13 
(23) 


3.89 
(19) 


1 learn faster In 
Job Corps than In school 
N» 


3.51 
(27) 


3.76 
(21) 


4.13 

(15) 


3.43 
(75) 


3.32 
(28) 


3.47 
(23) 


3.31 
(19) 


People could have a betteir 
life with acre education 


4.33 

(27) 


4,76 

(21) 


4.66 
(15) 


3.81 
(75) 


3.57 
(28) 


3.91 
(23) 


3.94 
(19) 


Job Cprps-^is helping ne 
learn thifvgs to Make ny 


4.18 

(27) 


4.66 

(21) 


4.73 

(15) 


3.84 

^ (75) 


3.57 
(28) 


3.65 
(23) 


4.21 

(19) 


Teachers In JC care aiore 

wfifln wKflwncr> in icnovi 


3.25 
(27) 


3.80 
(21) 


3.7'' 
(15) 


3.13 
(75) 


3.21 
(28) 


2.95 
(23) 


2.94 
(18) 


Yoy need ^aath t»> ^et a 
better Job 
ft- 


3.92 
(27) 


4.23 

(21) 


4.20 

(1i) 


4.11 

(75) 


4.35 
(28) 


3.69 
(23) 


3.58 
(17) 


t*ai 9)«d t entered JC 


4.14 

(27) 


4.04 

(21) 


4.33 

(15) 


3.84 
(75) 


4.07 

(28) 


3.43 

(23) 


3.36 
(19) 


You need to read to 
get a good Job 


4.18 

(27) 


4.52 

(21) 


4,80 
(15) 


3.91 
(75) 


3.50 
(28) 


3.86 
A (23) 


* 3.26 
(19) 


I $m treated fairly by 
ny JC teachers 
»• 


3.% 
(27) 


4.04 

(21) 


4.40 

(15) 


3.72 
(75) 


3.77 
(27) 


3.69 
(23) 

. 1 


3.63 
(19) 



Questions 



ll 1e«m things quickly 



Il'tnjoy learning 



ll 1t«rn faster In JoS 
■Corps th«n In school 



people could have a better 
Itlfe with more education 



Job Corps is helping me 
W\urn things to make my 
■future better 



iTtachers In JC care more 
Ithin teachers In school 



Tou need math to get a 
titer Job — _ 



\Vm glad I entered JC 



fou need to read to 
t a good job 

o 

I am treated fairly by 
JC teachers 



APL 
El Paso 



3.71 
(14) 



3.86 
(14) 



4.07 
(14) 



4.21 
(14) 



4.21 



(14) 



3.86 
(14) 



3.g3 
(14) 



4.00 
(14) 



3.86 
(14) 



3.79 
(14) 



TABLE 37 (contO 



Corpsmember Satisfaction Data By Model And Center 
Core Questions 



Job Corps 
Prooram 
El Paso 



4.00 

(13) 



3.92 
(13) 



3.92 
(13) 



4.23 

(13) 



4.54 



(13) 



4.00 
(13) 



4.00 

(13) 



,4.46 

(13) 



3.92 
(13) 



4.15 

(13) 



NRP 
Gary 



3.58 
(29) 



4.41 

(29) 



3.72 
(29) 



4.41 

(29) 



4.41 



(29) 



3.82 
(29) 



4.17 

(29) 



4.17 
(29) 



4.31 

(29) 



4.06 

(29) 



Job Corps 
Read. Program 
Gary 



3.03 
(27) 



4.29 

(27) 



3.66 
(27) 



4.07 

(27)' 



4.00 



(27) 



3.33 
(27) 



3.77 
(27) 



3.81 
(27) 



4.29 

(27) 



3.88 
(26) 



CAI 
Phoenix 



3.2 
(10) 



3,4 
(10) 



3.6 
(10) 



4.8 
(10) 



4.5 
(10) 



3.9 
(10) 



4.00 
(10) 



3.90 
(10) 



5.00 
(10) 



4.40 

(10) 



NRP 
Phoenix 



2,78 
(14) 



3.66 
(15) 



3.80 
(15) 



4.00 
(15) 



4.20 
(15) 



3.93 
(15) 



3.71 
(14) 



4.00 
(15) 



4.53 
(15) 



4.00 
(15) 



< 



o 



< 

o 




2^ 



11 Icirn things quickly 



|l enjoy leirnlna 



It letrn faster in Job 
porps thin In school 



It^ople could hive i better 
I life Mith more educitlon 



Jjb Corps Is helping me 
eirn things to mike my 
filture better 



Teichers In JC cire more 
thin teichers In school 
N- 



You need math to get a 
better Job 



Vm glid I entered JC 



You need to read to 
9it i good Job 



m treated fairly by 
JC teachers 



Adklns 
Pittsburgh 



3.46 
(15) 



3.93 
(15) 



3.40 
(15) 



4.40 
(15) 



4.33 



(15) 



3.66 
(15) 



4.26 
(15) 



3.46 
(15) 



4.26 

(15) 



3.80 
(15) 



TABLE 37 (cont.) 

Corpsmember Satisfaction Data By Model And Center 
Core Questions 



World of Work 
■-Pi ttsburgh 



3.81 
(11) 



4.45 

(11 



3.81 
(11) 



4.63 
(11) 



4.45 



(11) 



3.18 
(11) 



4.27 
(11) 



4.27 

(11) 



4.27 

(11) 



4.27 
(11) 



Cambr 1 dge 
GEO 

Tongue Po1nt_ 



4.40 

(5) 



4.00 
(5) 



4.60 
(5) 



5.00 
(5) 



4.80 



(5) 



4.40 
(5) 



4.60 
(5) 



4.80 
(5) 



4.20 
(5) 



4.25 
(4) 



Job Corps 
GEO 

_Tongue Point 



4.00 
(3) 



4,00 

(4) ' 



4.25 
(4) 



4.75 



4.75 



(4) 



3.75 
(4) 



.4.75 
(4) 



4.50 
(4) 



4.75 
(4) 



4.25 
(4) 



NRP 

Tongue Pointy 



3.78 
(33) 



4.45 

(33) 



3.84 
(32) 



4.57 

(33) 



4. 54 



(33) 



3\48 
(33) 



4.21 
(33) 



.4.48 
(33) 



4.39 
(33) 



4.03 
(33) 



Job Corps 
^ead. Program 
_ Tongue Point 

3.96 
(33) 



4.21 
(33) 



3.96 
(33) 

4.51 
(33) 



4.45 



(33) 



3.81 
(33) 



3.96 
(33) 



4.27 
(33) 



4.36 
(33) 

3.84 
(33) 
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TABLE 37 (contO 

Corpsmember Satisfaction Data By Model And Center 
Core Questions 



Questions 



1 learn things quickly 



I enjoy learning 
N- 



I learn faster In Job 
Corps than In school 



People could have a better 
life with more education 



Adklns 
Woodstock 



4.09 



4.54 

(11) 



3.45 
(11) 



4.18 

(11) 



World of Work 
Woodstock 



4.27 
(18) 



4.50 
(18) 



3.33 
(18) 



4.61 
(18) 



'^~m — 

Math 

Woodstock 



4.11 
(38) 



4.21 

(38) 



3.47 
(38) 



4.24 



Job Corps 

Hath 
Woodstock 



3.85 
(33) 



4.33 

(33) 



3.33 
.(33) 



4.64 

(33) 



Job Corps Is helping me 
learn things to make my 
future better 



4.45 

(11) 



Teachers In JC care more 
than teachers In school 
N« 



You need math to get a 
better job 



2.54 

(11) 



I'm glad I entered JC 



You need to read to 
get a good Job 



4.18 

(11) 



4.27 
(11) 



4.27 

(11) 



4.22 
(18) 



2.72 
(18) 



4.38 
(18) 



4.50 
(18) 



4.16 

(18) 



4.34 

(38) 



3.58 
(38) 



3.87 
(38) 



4.08 

(38) 



4.42 

(38) 



4.33 

(33) 



3.12 
(33) 

4.12 

(33) 



4.12 
(33) 



4.39 
(34) 



I Am treated fairly by 
«y JC teachers 
N< 



3.63 

(n) 



3.88 
(18) 



3.84 
(38) 



3.88 
(33) 



interviewers are involved as are different sites, and a differential 
effect from these ivas expected. However, what is worthy of note is 
that none of the item means were below 3.0, demonstrating that Job 
Corps enrollees who have taken the 90 hour posttest (remained in the 
program 4 1/2 months) are highly motivated, realize the value of 
education, and are pleased with the education they are getting in 
Job Corps. 

Program specific process evaluation data are being treated separately 
by model because fiifferent questions were contained in each question- 
- nalre. This data may be found in Tables 38-44. 

The data indicate, virtually without exception, that the enrollees in 
each of the experimental programs feel positively toward them. 
Barring some computer down time (Phoenix program suspension. PLATO 
difficulty during the summer), program. enrol lees appear to be satis- 
fied with the substance and operation of the experimental programs. 
However, there is no consistent pattern in favor of new programs 
as opposed to control programs. 

♦ 

It should be noted that sample sizes are still relatively small. The 
process data will continue to be tracked as the study progresses. 
More confidence can be placed in the results from a statistical 
perspective as the N in each program increases. However, the data 
is certainly consistent across programs demonstrating. that Corps- 
members are pleased with the skills they are learning in each. 
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TABLE 38 
ADKINS 





Adkins 
Woodstock 


Adklns 
Pi ttsburgh 


I like hiving lessons on television. 

V 




3.93 


The progriRS were easy to un(}erstind. 


» 


3.93 
MS) 


The things I leimed will help me get i better 
jot) when I leive J.C. 


3 
O 
r» 


4.40 
,(15) 


The group discussions were Interesting. 


urrei 


3.93 

V 13 / 


! think I learned how to keep job through this — 
program. 


r» 

*< 


4. AO 
MS) 


I wish more of the J.C. program was presented 
like this. 


< 


4.07" 
\ • J / 


Seeing myself on television helped me learn 
hew I look and sound to others. * 


C7 


4.00 
MS) 


After taking this program, I Mf not afraid of 
a job Interview. 




4.13 
(15) 


Because of this course, I feel 1 can take better 
care of my money when I leave J.C. 

— a 




3.13 
(15) 


Ny teachers had time to help me w?)en 1 needed It. 




4.27 
(15) 


I think I am learning faster In this program 
than my friends In the regular J.C. program 




3.80 
(15) 


Hy teacher liked using the Adklns progr«n. 




3. BO 
(15) 


The Adklns materials were Interesting. 




3.87 
(15) 


The Adklns materials are not too Immature for my age group. 




4.07 
(15) 



I 
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TABLE 39 

APL 
El Paso 



QUESTION 


ITEM 
MEAN 


N 


The things I learned in APL will help me get i job. 


4.07. 


14 


boing out into the community gave me confidence in 
getting a good job. 


3.50 


14 


1 w«5 ^Dic w get inrougn me materials at my own 
speed* 


3.57 


14 


I liked the fact that the APL program ^can help me get 

V 11 1 ^^11 d wiiuv i U 1 p 1 duA • 


4.14 


14 


Dc^audw wic Hia^eriais were jwD*reiaceo> i wanted to 
learn more. 


3.65 


14 


More people would want to" come to Job Corps If they 
knew they could get a high school diploma. 


4.27 


14 


^My teachers had enough time to help me when I needed it. 


3.93 


14 


The APL materials are not too iwwature for my age group. 


4.07 


14 


My teacher liked using this program with us. 


4.07 


14 


I think I am learning faster in APL than my friends in 
the regular Job Corps program. 


3.79 


14 
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TABLE 40 
CAI 



Questions 


Phoenix 


Clearfield 


rforkinQ ^\t\\ a computer makes me feel smart. 


3.40 
(10) 


(75) 


I would lUe to be able to spend more time on the computer 


2 50 
(10) 


J. CO 

(74) 


I Hke the f»ci that on the computer, other people don't 
inCM when I make a mistake. 


3.3C 
(10) 


3 14 
(75) 


I would rather work with a computer than a teacher. 


3. 20 
(10) 


4 34 

(75) 


The computer lets me work at my own speed. 


3.30 
(10) 


3.61 
(73) 


The programs on the computer make me want to work harder. 


A 10 

(10) 


J. OU 

Ob) 


The computer should be used more in Job Corps. 


3.80 
(10) 


3 64 
(75) 


1y teacher really Ifked workmg with the computer. 


3 70 

(io) 


3 75 
(75) 


The materials on the computer were not too imiature for 
i)y age group. 


3 70 

(io) 


(75) 


I think I am learning faster on the computer than my 

Tripnd^ whn Jkf^ nnt nc^nn if 
> t ic'iws wiiu QIC iiui U3 ny iL. 


3.00 
(9) 


3.23 
(69) 


V teacher had enough time to help me when I needed it. 


2.00 
(1) 


3.*14 
(62) 


fhe computer was not off so much of the time that I 
:ouldn't use it when I needed to. 




2.90 
(57) 
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Tabic 41 



CAI Math 
Woodstock 



QUESTION 


itEM 
MEAN 


N 


I would like to be able to spend more time working with 
the Classmate 88. 


3.33 


9 


The directions for working with the Classmate 88 are 
clear. 


3.78 


9 


Working with equipment like the Classmate 88 makes me 
feel smart. 


3.89 


9 


The problems on the Classmate 88 were not boring. 


3.78 


9 


I like the fact that when I work on the Classmate 88, 
other people don*t know when I make a mistake. 


3.89 


9 


Machines like the Classmate 88 should be used more In 
Job Corps. 


3.67 


9 


Classmate 88 lets me work at my own speed. 


3.56 


9 


The Classmate 88 was not broken so mcu that I couldn't 
use it when i needed to. 


3.67 


9 


The problems on Classmate 88 are not too Inmature for 
my age group. 


4.00 


9 


My teacher had enough time to help w when I needed it. 


4.11 


9 


I think I am learning faster on the Classmate 88 than 
my friends who are not using, it. 


^ 4.00 


9 


My teacher seemed to like working with the Classmate 88. 


3.89 


9 
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TABLE 42 



CAHBRlOCe GEO 



Ques t i ons 


. Breckinridqe 


Tongue Po'.r.t 


1 like having lessons on television. 




3,33 
(3) 


The programs were easy to understand. 


rr 


3.67 
(3) 


Tht other materials like books and study guides 
o>ve^ enough help when I needed it. 


b 
O 
rr 


3 33 
(3) 


The television lessons. were interesting to me. 


:u rre 


3 33 
(3) 


i could not. have gone throuqh the program faster 
without the television lessons. 




4 00 
(3) 


Programs on television should be used fwre in 
Job Corp. 


- 


3,33 
(3) 


I think I am learning faster using Cambridge than 
my friends who are not using it. 




3,67 
(3) 


My teacher liked using the Cambridge materials. 




4,00 
(3) 


The Cambridge materials are not too inmature for 
in> age group. 




3,00 
(3) 


teacher had enough time to help me when I needed 

It. 




3,33 
(3) 


The tests that were used in the books helped me to 
jet ready for the GEO test. 

1 ' 




4.00 
(2) 
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TABLE 43 

MRP 



Questions 


Ireckinridqe 


Clearfield 


Gary 


Phoenix 


Tonque Point 


The language and study skills portion of the pronram 

ic hAlnfiil 

1 > 'Ic 1 pi U 1 • 


4 11 

{27) 


3.17 
(28) 


4.31 
(29) 


3,06 
(15) 


3.93 
(33) 


It IS not taking me longer to get through the prograM 

k'lOL i tllUU^jflL iL WUUIO« ^ 


2,92 
{27} 


3.00 
(28) 


2.48 
(29) 


2.20 
(15) 


3.48 

(33) 


The materials 1 had read covered enough different 


[27) 


3,37 
(27) 


3.96 
(29) 


3.71 
(14) 


3.48 
(33) 


I like to read for fun more now than I did when I 
catne to Job Corps. 


3.66 
{27) 


2.71 
(28) 


3 96 
(29) 


3.40 
(15) 


3.87 
• (33) 


Tne things 1 read in my old school were not as good 
a* LUC LHiii^^ triot 1 am reaaing in JOD LOrps. 


3.00 
(27) 


3.39 
(28) 


3.31 
(29) 


3.86 
(15) 


3.21 

(33)' • 


My teacher had enough time to help me when I needed it. 


3.74 
(27) 


3.42 
(28) 


3.96 
(29) 


3.73 
(15) 


3.84 
(33) 


The reading program materials are not too irrmature 

fnr tnv /)nA nmiin 


3.77 
(27) 


3.32 
(28) 


3.58 
(29) 


3.53 
(15) 


3.57 
(33) 


By :he time 1 finish this program, I will really be 
ready for the reading part of the GEO. 


4.00 
(27) 


. 3.42 
(28) 


4.24 


3.53 
\ • 0 / 


4.09 
(33) 


My teacher really liked working with the reading 
program. 


4,07 


3.64 
(28) 


4.24 
(29) 


3.53 
(15) 


4.09 
(33) 


I think I am learning faster than my friends who 
are in other Job Corps reading programs 


3.46 
!26) 


3.50 
(14) 


3.5e 
(29) 


2.84 
(13) 


3.72 
(33) 
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TABLE 44 
STAFFING 



Questions 


Breckinridge 


Cleat field 


Havmg aides helped make the classes more interesting. 


4.40 
(15) 


3.38 
(18) 


I went through the program faster because the aides 
were there to help me. 


3.46 
(15) 


?.27 
(18) 


I got enough attention from my teacher even though 
there was an aide. 


4.13 
(15) 


3.22 
(18) 


Aides should be used more in Job Corps. 


4.06 
(15) 


(18) 


My teacher really liked having the aide. 


3.26 
(15) 


3.16 
(18) 


The aide respected me as a person. 


4.06 
(15) 


4.00 
(17) 


There were enough aides to help everyone when 
they needed it. 


3.73 
(15) 


3.16 
(18) 


\ think I am learning faster than my friends who 
are in classes without aides. 


4.40 
(15) 


3.33 
(18) 


One day I would like to be an aide in Job Corps. 


4.26 
(15) 


3.05 
(18) 
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Preliminary data from the teachers involved in the EIE study Indicate 
they are pleased with the model programs, they are excited about 
experimentation in Job Corps, and that they would like to participate- 
in future Job Corps experimentation. Data on program impact on the 
center operations will be available shortly. It should be noted that 
where requirements for Cohort 1 operation impacted negatively on 
centers, modifications were made to Cohort 2 operations in an attempt 
to make programs more workable within Job Corps. Data on the efficacy 
of the modifications will be available as the study progresses. 
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